-- Logs begin at Mon 2022-05-23 19:26:58 UTC, end at Mon 2022-05-23 20:40:15 UTC. -- May 23 20:13:53.621462 dv-cinder-843018-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 20:13:53.628746 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 20:13:53 2022] *** May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: nodename: dv-cinder-843018-1-iscsi May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: machine: x86_64 May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: clock source: unix May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: pcre jit disabled May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: detected number of CPU cores: 4 May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: current working directory: / May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: detected binary path: /usr/bin/uwsgi-core May 23 20:13:53.631871 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: your processes number limit is 47680 May 23 20:13:53.632512 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: your memory page size is 4096 bytes May 23 20:13:53.632512 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: detected max file descriptor number: 2048 May 23 20:13:53.632512 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: lock engine: pthread robust mutexes May 23 20:13:53.632512 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: thunder lock: enabled May 23 20:13:53.632512 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 20:13:53.632512 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 20:13:53.679639 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: Python main interpreter initialized at 0x55594d9f99c0 May 23 20:13:53.679639 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: python threads support enabled May 23 20:13:53.679639 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: your server socket listen backlog is limited to 100 connections May 23 20:13:53.679639 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: your mercy for graceful operations on workers is 90 seconds May 23 20:13:53.680036 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: mapped 403077 bytes (393 KB) for 2 cores May 23 20:13:53.680115 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: *** Operational MODE: preforking *** May 23 20:13:53.680329 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: *** uWSGI is running in multiple interpreter mode *** May 23 20:13:53.680329 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: spawned uWSGI master process (pid: 103735) May 23 20:13:53.680533 dv-cinder-843018-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 20:13:53.686041 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: spawned uWSGI worker 1 (pid: 103736, cores: 1) May 23 20:13:53.686041 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: spawned uWSGI worker 2 (pid: 103737, cores: 1) May 23 20:13:53.686041 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 20:13:54.853355 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 20:13:54.853965 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 20:13:55.574587 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:13:55.574587 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: from cryptography.utils import int_from_bytes May 23 20:13:55.574852 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:13:55.574852 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: from cryptography.utils import int_from_bytes May 23 20:13:55.574971 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:13:55.574971 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: from cryptography.utils import int_from_bytes May 23 20:13:55.575216 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:13:55.575216 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: from cryptography.utils import int_from_bytes May 23 20:13:58.162498 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 20:13:58.163101 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 20:13:58.163467 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 20:13:58.163574 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 20:13:58.163658 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 20:13:58.163738 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 20:13:58.163825 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 20:13:58.163918 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 20:13:58.163998 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 20:13:58.164076 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 20:13:58.164215 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.164403 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.164566 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.164731 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.164843 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.165055 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.165154 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.165377 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.165476 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.165710 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.165798 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.166040 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.166130 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.166364 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.166452 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.166685 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.166777 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.166940 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.167034 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.167251 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.167346 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.167565 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.167651 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-1-iscsi {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.168403 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.168507 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-1-iscsi {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.168709 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.168805 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.169016 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.169109 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.169327 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.169426 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.169626 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.169722 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.169941 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.170045 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.170272 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.170370 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.170589 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.170768 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.171095 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.171236 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.171411 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.171525 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.171722 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.171835 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.172036 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.172179 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.172371 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.172487 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.172698 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.172801 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.173001 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.173104 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.173304 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.173399 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.173613 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.173723 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.173914 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.174035 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.174261 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.174346 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-1-iscsi {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.174624 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.174715 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-1-iscsi {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.174934 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.175027 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.175245 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.175340 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.175574 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.175661 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.175942 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.176043 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.176243 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.176330 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.176558 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.176662 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.176873 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.176984 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.177190 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.177288 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.177491 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.177583 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.177804 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.177896 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.178141 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.178245 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.178460 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.178558 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.178755 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.178852 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.179056 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.179148 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.179356 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.179442 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.179679 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.179813 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.179957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.180050 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.180261 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.180355 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.180506 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.180592 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.180798 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.180884 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.181107 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.181211 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.181416 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.181508 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.181732 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.181826 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.181979 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.182109 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.182260 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.182347 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.182558 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.182692 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.182874 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.182962 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.183176 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.183269 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.183527 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.184207 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.184334 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.184422 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.184638 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.184731 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.184939 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.185037 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.185239 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.185332 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.185540 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.185626 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.185839 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.185933 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.186176 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.186267 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.186488 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.186586 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.186802 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.186896 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.187103 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.187201 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.187416 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.187503 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.187736 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.187845 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.188044 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.188137 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.188343 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.188436 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.188673 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.188764 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.188982 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.189080 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.189284 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.189377 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.189598 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.189696 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.189913 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.190029 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.190245 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.190348 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.190548 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.190641 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.190851 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.190942 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.191157 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.191257 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.191472 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.191562 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.191775 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.191874 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.192024 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.192142 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.192320 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.192415 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.192617 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.192709 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.192920 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.193016 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.193224 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.193308 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.193526 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.193620 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.193828 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.193924 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.194154 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.194286 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.194456 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.194551 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.194756 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.194863 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.195059 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.195145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.195362 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.195456 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.195664 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.195751 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.195967 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.196051 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.196272 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.196357 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.196582 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.196677 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.196891 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.196977 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.197197 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.197283 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.197517 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.197618 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.197827 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.197912 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.198157 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.198248 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.198460 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.198554 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.198763 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.198864 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.199099 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.199190 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.199405 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.199492 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.199707 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.199795 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.200014 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.200119 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.200319 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.200406 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.200622 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.200709 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.200926 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.201026 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.201224 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.201311 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.201526 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.201611 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.201833 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.201924 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.202158 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.202258 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.202465 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.202558 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.202770 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.202870 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.203069 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.203158 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.203369 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.203455 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.203668 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.203762 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.203970 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.204055 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.204269 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.204397 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.204569 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.204665 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.204868 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.204962 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.205165 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.205259 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.205461 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.205556 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.205760 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.205851 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.206095 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.206185 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.206401 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.206490 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.206701 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.206794 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.207002 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.207088 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.207305 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.207398 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.207627 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:13:58.207713 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.207951 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.208035 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.208281 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.208367 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.208588 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.208680 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.208916 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.209006 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.209243 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.209336 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.209558 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.209644 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.209868 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.209961 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.210530 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.210655 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.210761 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.210865 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.210968 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.211086 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.211193 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.211309 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.211415 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.211530 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.211718 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.211839 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.212029 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.212140 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.212346 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.212467 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.212659 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.212778 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215084 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215221 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215320 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215405 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215487 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215577 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215658 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215743 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215823 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215901 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.215987 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216079 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216166 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216252 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216333 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216411 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216500 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216581 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.216659 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217003 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217084 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217162 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217249 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217337 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217416 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217495 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217573 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217658 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217750 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217831 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.217909 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.218004 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.218222 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.218350 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.218535 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.218650 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.218878 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.219009 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.219158 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.219281 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.219469 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.219582 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.219776 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.219889 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.220085 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.220205 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.220397 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.220528 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.220707 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.220825 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.221023 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.221144 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.221335 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.221454 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.221641 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.221752 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.221949 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.222119 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.222281 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.222392 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.222588 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223185 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223281 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223359 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223486 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223571 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223650 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223737 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223824 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.223905 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.224040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.224128 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.224338 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.224434 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.224653 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.224742 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.224972 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.225059 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.225273 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.225373 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.225589 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.225681 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.225890 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.225983 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.226223 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.226325 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.226530 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.226617 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.226836 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.226921 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.227136 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.227223 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.227438 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.227532 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.227741 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.227826 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.228041 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.228129 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.228344 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.228429 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.228653 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.228745 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.228953 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.229093 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.229260 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.229346 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.229558 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.229643 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.229858 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.229947 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.230194 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.230293 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.231017 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.231118 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.231324 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.231417 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.231629 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.231716 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.231934 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.232028 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.232243 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.232328 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.232550 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.232635 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.232859 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.232959 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.233170 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.233255 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.233501 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.233585 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.233802 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.233897 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.234145 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.234236 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.234469 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.234567 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.234782 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.234869 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.235082 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.235181 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.235388 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.235475 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.235687 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.235774 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.235986 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.236072 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.236285 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.236371 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.236587 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.236680 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.236883 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.236974 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.237181 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.237275 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.237480 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.237568 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.237780 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.237864 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.238108 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.238207 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.238416 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.238503 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.238736 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.238822 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.239019 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.239157 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.239318 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.239405 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.239616 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.239702 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.239917 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.240010 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.240236 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.240328 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.240554 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.240639 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.240892 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.241029 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.241206 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.241300 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.241523 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.241618 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.241830 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.241917 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.242167 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.242270 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.242487 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.242573 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.242802 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.242890 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.243114 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.243199 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.243427 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.243514 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.243742 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.243829 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.244050 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.244144 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.244358 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.244442 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.244660 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.244745 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.244980 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.245072 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.245287 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.245381 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.245597 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.245681 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.245895 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.246029 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.246789 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.246890 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.247108 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.247195 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.247450 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.247537 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.247784 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.247880 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.248103 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.248189 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.248407 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.248493 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.248717 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.248817 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.249024 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.249118 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.249329 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.249418 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.249635 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.249731 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.249940 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.250078 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.250274 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.250371 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.250575 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.250662 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.250888 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.250974 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.251188 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.251272 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.251503 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.251589 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.251807 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.251891 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.252120 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.252208 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.252417 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.252505 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.252722 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.252816 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.253033 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.253117 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.253357 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.253442 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.253662 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.253748 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.253970 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.254092 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.254312 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.254404 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.254615 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.254700 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.254918 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.255059 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.255225 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.255320 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.255524 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.255611 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.255823 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.255922 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.256126 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.256218 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.256432 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.256517 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.256735 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.256831 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.257038 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.257124 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.257338 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.257424 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.257641 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.257729 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.257940 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.258044 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.258266 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.258352 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.258564 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.258654 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.258864 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.258950 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.259174 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.259259 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.259478 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.259567 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.259791 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.259882 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.260105 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.260189 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.260407 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.260495 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.260714 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.260801 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.261016 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.261100 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.261332 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.261420 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.261658 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.261754 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.261959 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.262078 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.262285 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.262371 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.262589 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.262675 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.262919 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.263014 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.263218 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.263305 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.263527 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.263611 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.263840 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.263982 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.264144 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.264231 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.264457 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.264590 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.264764 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.264877 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.265070 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.265174 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.265377 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.265464 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.265684 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.265771 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.265989 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.266125 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.266317 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.266412 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.266623 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.266710 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.266928 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.267014 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.267233 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.267326 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.267539 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.267625 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.267841 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.267938 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.268146 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.268232 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.268450 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.268536 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.268748 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.268835 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.269048 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.269141 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.269354 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.269476 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.269666 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.269920 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.270256 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.270364 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.270573 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.270665 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.270887 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.270973 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.271199 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.271344 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.271514 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.271599 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.271832 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.271918 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.272158 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.272252 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.272474 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.272559 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.272778 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.272872 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.273086 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.273183 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.273387 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.273487 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.273687 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.273773 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.273989 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.274087 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.274331 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.274429 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.274631 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.274716 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.274931 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.275018 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.275235 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.275330 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.275531 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.275620 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.275829 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.275916 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.276125 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.276220 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.276425 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.276511 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.276729 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.276821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.277027 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.277114 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.277353 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.277447 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.277652 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.277736 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.277958 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.278067 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.278287 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.278385 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.278586 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.278673 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.278885 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.278973 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.279183 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.279268 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.279485 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.279625 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.279803 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.279889 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.280117 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.280202 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.280441 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.280534 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.280766 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.280851 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.281068 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.281153 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.281368 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.281463 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.281688 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.281775 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.281989 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.282131 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.282312 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.282410 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.282611 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.282697 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.282912 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.282997 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.283211 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.283298 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.283508 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.283595 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.283809 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.283901 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.284110 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.284196 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.284415 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.284499 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.284715 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.284808 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285014 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285100 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285315 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285407 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285612 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285704 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285912 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.285996 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.286237 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.286322 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.286536 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.286635 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.286834 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.286921 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.287134 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.287218 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.287431 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.287524 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.287727 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.287852 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.288025 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.288112 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.288319 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.288412 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.288621 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.288706 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.288918 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.289004 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.289215 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.289312 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.289514 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.289612 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.289813 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.289899 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.290136 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.290225 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.290435 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.290521 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.290741 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.290825 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.291052 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.291140 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.291350 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.291436 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.291648 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.291735 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.291950 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.292036 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.292245 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.292330 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.292544 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.292637 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.293365 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.293460 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.293676 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.293763 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.293986 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.294098 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.294309 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.294398 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.294615 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.294702 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.294915 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.295011 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.295217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.295302 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.295513 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.295605 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.295816 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.295910 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.296110 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.296203 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.296406 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.296492 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.296701 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.296795 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.297004 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.297097 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.297307 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.297401 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.297611 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.297698 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.297933 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.298081 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.298264 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.298363 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.298568 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.298655 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.298862 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.298946 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.299162 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.299254 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.299481 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.299567 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.299792 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.299884 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.300121 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.300213 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.300431 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.300517 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.300741 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.300826 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.301043 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.301141 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.301353 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.301444 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.301657 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.301741 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.301956 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.302073 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.302294 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.302388 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.302598 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.302685 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.302905 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.303003 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.303203 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.303290 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.303499 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.303585 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.303801 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.303899 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.304105 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.304190 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.304409 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.304497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.304715 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.304802 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.305029 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.305113 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.305346 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.305432 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.305647 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.305773 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.305951 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.306119 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.306290 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.306379 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.306603 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.306690 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.306913 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.306999 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.307218 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.307303 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.307524 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.307612 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.307830 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.307916 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.308136 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.308230 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.308464 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.309046 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.309293 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.309380 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.309606 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.309701 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.309914 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.310040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.310242 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.310328 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.310543 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.310644 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.310847 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.310932 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.311154 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.311239 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.311459 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.311621 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.311761 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.311847 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.312057 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.312149 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.312360 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.312453 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.312657 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.312749 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.312964 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.313079 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.313387 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.313473 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.313693 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.313780 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.313993 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.314142 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.314318 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.314444 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.314622 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.314706 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.314931 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.315015 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.315237 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.315329 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.315540 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.315661 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.315844 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.315938 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.316246 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.316332 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.316553 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.316648 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.316859 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.316953 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.317160 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.317246 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.317459 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.317546 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.317759 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.317853 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.318095 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.318186 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.318397 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.318483 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.318697 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.318803 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.318996 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.319083 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.319298 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.319383 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.319602 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.319688 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.319928 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.320067 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.320231 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.320325 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.320609 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.320695 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.320909 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.320996 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.321236 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.321320 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.321621 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.321713 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.321927 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.322053 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.322270 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.322355 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.322586 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.322681 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.322905 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.322991 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.323205 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.323301 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.323513 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.323608 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.323817 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.323904 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.324148 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.324237 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.324474 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.324570 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.324777 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.324863 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.325087 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.325183 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.325385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.325485 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.325697 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.325790 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.326029 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.326118 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.326343 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.326443 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.326659 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.326744 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.326983 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.327077 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.327366 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.327461 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.327671 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.327760 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.327987 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.328074 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.328306 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.328393 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.328606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.328691 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.328906 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.328994 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.329211 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.329306 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.329508 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.329601 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.329809 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.329896 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.330134 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.330235 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.330445 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.330531 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.330753 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.330840 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.331062 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.331148 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.331371 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.331458 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.331669 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.331769 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.331966 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.332054 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.332266 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.332358 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.332569 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.332667 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.332876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.332969 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.333181 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.333274 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.333496 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.333590 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.333809 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.333902 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.334132 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.334221 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.334451 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.334548 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.334753 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.334841 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.335053 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.335148 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.335352 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.335447 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.335654 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.335740 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.335960 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.336081 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.336271 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.336358 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.336587 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.336681 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.336904 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.336990 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.337224 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.337311 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.337531 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.337626 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.337848 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.337933 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.338189 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.338278 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.338502 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.338589 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.338816 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.338920 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.339136 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.339222 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.339434 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.339519 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.339756 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.339859 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.340063 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.340150 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.340363 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.340449 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.340662 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.340757 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.340963 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.341057 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.341268 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.341354 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.341564 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.341658 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.342147 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.342239 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.342451 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.342536 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.342756 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.342845 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.343053 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.343139 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.343371 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.343458 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.343676 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.343763 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.343976 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.344071 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.344277 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.344369 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.344571 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.344657 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.344872 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.344957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.345190 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.345283 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.345514 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.345601 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.345826 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.345912 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.346169 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.346271 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.346493 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.346578 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.346795 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.346888 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.347114 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.347209 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.347427 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.347514 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.347738 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.347825 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.348049 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.348149 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.348361 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.348449 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.348672 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.348760 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.348981 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.349077 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.349289 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.349377 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.349592 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.349679 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.349899 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.349985 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.350231 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.350363 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.350543 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.350641 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.350858 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.351055 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.351378 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.351465 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.351686 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.351772 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.351996 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.352092 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.352307 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.352394 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.352614 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.352699 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.352919 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.353006 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.353224 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.353311 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.353527 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.353627 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.353831 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.353926 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.354162 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.354252 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.354471 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.354573 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.354789 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.354875 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.355110 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.355195 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.355956 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.356095 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.356268 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.356355 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.356581 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.356667 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.356893 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.356981 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.357203 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.357297 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.357519 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.357612 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.357847 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.357941 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.358176 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.358266 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.358486 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.358652 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.358794 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.358888 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.359103 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.359204 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.359410 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.359505 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.359715 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.359811 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.360023 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.360110 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.360325 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.360460 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.360629 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.360724 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.360933 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.361021 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.361242 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.361329 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.361545 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.361638 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.361857 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.361943 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.362206 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.362296 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.362524 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.362612 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.362833 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.362928 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.363144 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.363232 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.363454 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.363541 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.363765 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.363969 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.364277 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.364365 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.364595 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.364725 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.364910 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.365006 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.365231 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.365326 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.365558 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.365682 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.365986 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.366250 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.366250 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.366463 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.366463 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.366626 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.366773 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.366862 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.367078 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.367165 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.367384 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.367471 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.367683 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.367770 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.367984 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.368069 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.368291 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.368377 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.368590 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.368687 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.368892 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.368979 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.369192 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.369278 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.369506 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.369719 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.370058 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.370149 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.370408 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.370548 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.370725 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.370819 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.371597 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.371692 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.371927 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.372072 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.372244 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.372381 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.372551 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.372702 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.372877 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.373006 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.373183 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.373310 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.373491 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.373621 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.373806 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.373927 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.374141 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.374254 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.374449 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.374556 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.374756 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.374852 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.375070 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.375157 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.375378 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.375472 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.375683 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.375777 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.375996 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.376083 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.376300 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.376387 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.376606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.376693 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.376906 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.376995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.377206 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.377293 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.377508 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.377595 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.377803 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.377895 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.378125 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.378234 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.378425 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.378519 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.378722 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.378815 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.379025 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.379127 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.379320 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.379406 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.379622 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.379709 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.379920 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.380015 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.380219 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.380305 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.380514 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.380639 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.380816 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.380912 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.381122 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.381215 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.381462 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.381548 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.381769 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.381857 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.382090 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.382191 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.382396 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.382486 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.382698 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.382785 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.383009 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.383095 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.383312 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.383397 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.383616 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.383705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.383923 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.384009 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.384251 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.384338 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.384566 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.384773 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.385098 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.385185 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.385412 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.385506 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.385739 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.385834 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.386097 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.386198 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.386404 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.386501 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.386734 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.386822 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.387038 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.387124 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.387355 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.387453 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.387659 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.387752 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.387965 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.388056 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.388268 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.388356 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.388571 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.388657 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.388873 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.388961 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.389176 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.389264 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.389481 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.389569 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.389784 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.389871 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.390110 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.390200 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.390415 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.390513 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.390720 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.390806 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.391020 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.391107 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.391327 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.391413 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.391642 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.391737 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.391969 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.392055 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.392284 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.392377 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.392596 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.392690 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.392908 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.393001 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.393217 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.393304 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.393525 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.393624 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.393832 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.393918 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.394162 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.394253 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.394473 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.394561 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.394793 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.394888 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.395101 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.395193 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.395401 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.395490 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.395720 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.395805 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.396107 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.396193 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.396423 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.396517 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.396739 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.396826 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.397046 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.397141 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.397356 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.397441 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.397670 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.397756 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.397992 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.398118 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.398329 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.398416 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.398651 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.398738 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.398963 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.399059 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.399295 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.399381 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.399615 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.399700 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.399936 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.400024 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.400238 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.400338 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.400540 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.400627 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.400841 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.400928 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.401145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.401231 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.401453 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.401539 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.401764 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.401851 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.402087 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.402209 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.402414 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.402510 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.402720 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.402806 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.403016 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.403102 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.403314 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.403413 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.403614 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.403701 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.403912 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.404007 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.404215 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.404309 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.404509 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.404603 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.404807 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.404902 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.405105 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.405202 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.405403 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.405490 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.405701 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.405788 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.405998 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.406127 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.406321 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.406409 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.406621 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.406707 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.406923 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.407019 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.407218 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.407310 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.407514 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.407609 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.407812 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.407900 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.408112 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.408198 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.408446 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.408533 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.408751 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.408837 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.409070 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.409158 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.409377 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.409471 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.409690 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.409775 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.409994 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.410147 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.410334 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.410430 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.410648 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.410742 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.410959 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.411053 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.411265 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.411360 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.411573 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.411659 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.411905 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.412021 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.412217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.412340 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.412575 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.412677 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.412841 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.412928 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.413152 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.413243 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.413463 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.413550 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.413772 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.413859 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.414127 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.414220 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.414454 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.414553 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.414763 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.414850 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.415074 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.415170 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.415393 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.415526 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.415708 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.415810 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.416016 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.416109 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.416325 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.416410 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.416633 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.416727 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.416937 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.417024 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.417245 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.417339 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.417551 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.417647 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.418397 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.418493 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.418712 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.418798 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.419024 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.419120 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.419337 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.419422 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.419655 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.419747 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.419961 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.420057 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.420279 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.420371 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.420596 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.420687 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.420921 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.421047 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.421225 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.421313 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.421561 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.421649 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.421882 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.421971 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.422222 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.422312 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.422531 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.422627 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.422831 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.422918 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.423072 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 20:13:58.423159 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:13:58.423363 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 20:13:58.482207 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO dbcounter [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Registered counter for database nova_api May 23 20:13:58.482603 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO dbcounter [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Registered counter for database nova_api May 23 20:13:58.502934 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_db.sqlalchemy.engines [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.506440 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_db.sqlalchemy.engines [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.509573 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writer thread running {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:58.513149 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writer thread running {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:58.567076 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.context [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95806c6f-3d47-4566-84e6-920ffa618b20(cell1) {{(pid=103737) load_cells /opt/stack/nova/nova/context.py:464}} May 23 20:13:58.570646 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.context [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95806c6f-3d47-4566-84e6-920ffa618b20(cell1) {{(pid=103736) load_cells /opt/stack/nova/nova/context.py:464}} May 23 20:13:58.571206 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:13:58.572750 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:13:58.573528 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:13:58.574790 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_concurrency.lockutils [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:13:58.575585 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:13:58.576347 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_concurrency.lockutils [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:13:58.577165 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_concurrency.lockutils [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:13:58.577558 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO dbcounter [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Registered counter for database nova_cell0 May 23 20:13:58.579171 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_concurrency.lockutils [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:13:58.581264 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO dbcounter [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Registered counter for database nova_cell0 May 23 20:13:58.581508 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO dbcounter [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Registered counter for database nova_cell1 May 23 20:13:58.585395 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO dbcounter [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Registered counter for database nova_cell1 May 23 20:13:58.590216 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_db.sqlalchemy.engines [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.590741 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_db.sqlalchemy.engines [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.593589 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_db.sqlalchemy.engines [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.595575 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writer thread running {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:58.596142 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_db.sqlalchemy.engines [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.603173 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writer thread running {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:58.604455 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writer thread running {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:58.738382 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writer thread running {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:58.747099 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO dbcounter [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Registered counter for database nova_cell0 May 23 20:13:58.753325 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO dbcounter [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Registered counter for database nova_cell0 May 23 20:13:58.753754 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_db.sqlalchemy.engines [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.758000 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writer thread running {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:58.761922 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG oslo_db.sqlalchemy.engines [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:13:58.766264 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writer thread running {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:13:59.156356 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: WARNING keystonemiddleware.auth_token [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:13:59.163582 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: WARNING keystonemiddleware.auth_token [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:13:59.176674 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: WARNING keystonemiddleware.auth_token [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:13:59.183797 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: WARNING keystonemiddleware.auth_token [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:13:59.507155 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: WARNING keystonemiddleware.auth_token [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:13:59.513554 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: WARNING keystonemiddleware.auth_token [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:13:59.518832 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55594d9f99c0 pid: 103737 (default app) May 23 20:13:59.520894 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:13:59.522093 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: WARNING keystonemiddleware.auth_token [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:13:59.522192 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 May 23 20:13:59.522733 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Mon May 23 20:13:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:13:59.528483 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: WARNING keystonemiddleware.auth_token [None req-50f1ed6c-3feb-4745-9ac5-c041cde1f2fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:13:59.533705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55594d9f99c0 pid: 103736 (default app) May 23 20:15:19.194364 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:19.195358 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 23 20:15:19.195743 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:19.208351 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writing DB stats nova_api:SELECT=3 {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:19.209469 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writing DB stats nova_cell1:SELECT=3 {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:19.210506 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writing DB stats nova_cell0:SELECT=3 {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:19.211800 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:19.652267 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-072927b1-1066-4f20-877f-17057c09d162 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:19.682754 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-072927b1-1066-4f20-877f-17057c09d162 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479393 May 23 20:15:19.689252 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 20:15:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:15:21.939913 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:21.941479 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-ae2ad7e3-8aee-48eb-ada5-6d10ff102e26 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 May 23 20:15:21.942132 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:22.004822 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-28c808bd-37a4-4bfe-a2e7-49a27f866df9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:22.024241 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:15:22.024241 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: warnings.warn(msg) May 23 20:15:22.128839 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-28c808bd-37a4-4bfe-a2e7-49a27f866df9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.179953 May 23 20:15:22.129337 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:15:22.344558 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-6db5c5d3-731b-42d1-9119-ee90fce5cb54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:22.347007 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:15:22.347007 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: warnings.warn(msg) May 23 20:15:22.349671 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_api:SELECT=3 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:22.350552 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_cell1:SELECT=3 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:22.351728 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_cell0:SELECT=3 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:22.352633 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:15:22.504034 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-6db5c5d3-731b-42d1-9119-ee90fce5cb54 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.365519 May 23 20:15:22.504547 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 20:15:22 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:15:24.727094 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-28c808bd-37a4-4bfe-a2e7-49a27f866df9 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:24.728105 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-28c808bd-37a4-4bfe-a2e7-49a27f866df9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 23 20:15:24.728564 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:24.847945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-86e386a4-d418-4a16-88eb-f6ad4570a404 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:24.865160 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:15:24.865160 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: warnings.warn(msg) May 23 20:15:24.971161 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-86e386a4-d418-4a16-88eb-f6ad4570a404 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.236625 May 23 20:15:24.971731 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:15:24.983564 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-fca80e46-a94c-43d1-a9fc-a316d8a527c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:24.985159 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:15:24.985159 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: warnings.warn(msg) May 23 20:15:25.088902 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-fca80e46-a94c-43d1-a9fc-a316d8a527c1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109006 May 23 20:15:25.089506 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 20:15:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:15:27.363114 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-86e386a4-d418-4a16-88eb-f6ad4570a404 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:27.364133 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-86e386a4-d418-4a16-88eb-f6ad4570a404 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 23 20:15:27.364537 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:27.423509 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-66e6a610-f79c-43d6-b821-0762a1ef0882 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "ram": 1024, "disk": 10}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:27.502337 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-66e6a610-f79c-43d6-b821-0762a1ef0882 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131643 May 23 20:15:27.502998 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:15:27.514812 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-bcf91ad0-e09e-4f14-8a40-d3f9b2f8d252 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:27.592314 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-bcf91ad0-e09e-4f14-8a40-d3f9b2f8d252 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081059 May 23 20:15:27.593288 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 20:15:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:15:29.835087 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-66e6a610-f79c-43d6-b821-0762a1ef0882 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:29.836098 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-66e6a610-f79c-43d6-b821-0762a1ef0882 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 23 20:15:29.836686 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:29.899262 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-4289ba2c-2b96-4081-8ad0-8a79f4ce1ff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "disk": 10, "ram": 2048, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:29.977493 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-4289ba2c-2b96-4081-8ad0-8a79f4ce1ff6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133780 May 23 20:15:29.978100 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:15:29.990296 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-0163b253-da1d-4f18-ac58-69d9696f528e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:30.070240 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-0163b253-da1d-4f18-ac58-69d9696f528e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083622 May 23 20:15:30.070741 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 20:15:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:15:32.317683 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-4289ba2c-2b96-4081-8ad0-8a79f4ce1ff6 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:32.318777 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-4289ba2c-2b96-4081-8ad0-8a79f4ce1ff6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 May 23 20:15:32.319173 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:32.378723 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-cb658cbc-0886-47f0-ba33-8770ff078261 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:32.455864 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-cb658cbc-0886-47f0-ba33-8770ff078261 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130544 May 23 20:15:32.456792 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:15:32.468745 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-42c812f8-8dff-40de-af1c-5f2acbb65e29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:32.528224 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-42c812f8-8dff-40de-af1c-5f2acbb65e29 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063355 May 23 20:15:32.528926 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Mon May 23 20:15:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:15:34.761597 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-cb658cbc-0886-47f0-ba33-8770ff078261 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:34.762723 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-cb658cbc-0886-47f0-ba33-8770ff078261 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 23 20:15:34.763121 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:34.824468 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-03fa1e03-070c-4c8e-a0d2-028bcf12c405 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:34.848179 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-03fa1e03-070c-4c8e-a0d2-028bcf12c405 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079084 May 23 20:15:34.854076 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 20:15:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:15:37.083559 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-cb658cbc-0886-47f0-ba33-8770ff078261 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:37.084557 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-cb658cbc-0886-47f0-ba33-8770ff078261 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 23 20:15:37.084958 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:37.143789 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-bf854db1-8ed7-412c-a344-44ec41b637d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "id": "1", "vcpus": 1}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:37.227199 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-bf854db1-8ed7-412c-a344-44ec41b637d7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136104 May 23 20:15:37.227996 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:15:37.239994 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-ba138075-026a-4e9d-b857-0c92575a79fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:37.328762 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-ba138075-026a-4e9d-b857-0c92575a79fa admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092584 May 23 20:15:37.329226 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 20:15:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:15:39.555956 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-bf854db1-8ed7-412c-a344-44ec41b637d7 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:39.556975 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-bf854db1-8ed7-412c-a344-44ec41b637d7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 23 20:15:39.557961 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:39.617452 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-2e5cc02d-b789-4550-86b1-1f8d8e999d68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "2", "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:39.719238 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-2e5cc02d-b789-4550-86b1-1f8d8e999d68 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.155111 May 23 20:15:39.719808 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:15:39.732433 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-cd2335dc-766c-438b-9585-948916c4fd76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:39.818948 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-cd2335dc-766c-438b-9585-948916c4fd76 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090807 May 23 20:15:39.819574 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 20:15:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:15:42.495005 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-2e5cc02d-b789-4550-86b1-1f8d8e999d68 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:42.495967 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-2e5cc02d-b789-4550-86b1-1f8d8e999d68 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 May 23 20:15:42.496392 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:42.552569 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-eaa9eb8f-9346-45e8-9977-88e1dd328e0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:42.654936 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-eaa9eb8f-9346-45e8-9977-88e1dd328e0c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.152567 May 23 20:15:42.655666 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:15:42.667985 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-cd171b2b-c240-41ff-91f2-1377389731c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:42.760759 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-cd171b2b-c240-41ff-91f2-1377389731c5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096775 May 23 20:15:42.761666 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 20:15:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:15:45.017508 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-eaa9eb8f-9346-45e8-9977-88e1dd328e0c admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:45.019155 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-eaa9eb8f-9346-45e8-9977-88e1dd328e0c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 May 23 20:15:45.019666 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:45.077329 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b1b6a3d-80d5-4700-8e1a-a2ec1365da8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:45.129357 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b1b6a3d-80d5-4700-8e1a-a2ec1365da8c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.104203 May 23 20:15:45.129914 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:15:45.142595 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-81ec184a-6c73-4f34-8b98-332cb9ca74c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:45.221411 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-81ec184a-6c73-4f34-8b98-332cb9ca74c8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082411 May 23 20:15:45.226044 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 20:15:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:15:47.561004 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b1b6a3d-80d5-4700-8e1a-a2ec1365da8c admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:15:47.562028 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b1b6a3d-80d5-4700-8e1a-a2ec1365da8c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 23 20:15:47.582524 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:15:47.621774 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-d19c1ba0-1376-47fd-b57e-73c440ee51c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5"}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:47.839011 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-d19c1ba0-1376-47fd-b57e-73c440ee51c4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.270074 May 23 20:15:47.839477 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Mon May 23 20:15:47 2022] POST /compute/v2.1/flavors => generated 408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:15:47.853464 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-f01da309-6aa3-4814-b382-0692e87d16c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:15:47.941337 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-f01da309-6aa3-4814-b382-0692e87d16c7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089839 May 23 20:15:47.943674 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Mon May 23 20:15:47 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:16:12.377728 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-d19c1ba0-1376-47fd-b57e-73c440ee51c4 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:12.378773 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-d19c1ba0-1376-47fd-b57e-73c440ee51c4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 23 20:16:12.379191 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:12.389743 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:16:12.437142 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-ec90e6ff-7e1d-4ec9-a759-afc1f9b3c116 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:12.453856 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-ec90e6ff-7e1d-4ec9-a759-afc1f9b3c116 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068635 May 23 20:16:12.454405 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 20:16:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:16:13.427144 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-d19c1ba0-1376-47fd-b57e-73c440ee51c4 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:13.428144 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-d19c1ba0-1376-47fd-b57e-73c440ee51c4 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 May 23 20:16:13.428536 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:13.635009 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-66db1585-168e-41ef-b073-0a166ca9e592 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:13.640576 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.wsgi [None req-66db1585-168e-41ef-b073-0a166ca9e592 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-66db1585-168e-41ef-b073-0a166ca9e592 admin admin] Request method failure captured: May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Accept: application/json May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Accept-Encoding: gzip, deflate May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Connection: keep-alive May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Content-Length: 0 May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Host: 10.222.0.16 May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Openstack-Api-Version: compute 2.90 May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Openstack-System-Scope: None May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: User-Agent: python-novaclient May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Auth-Token: gAAAAABii-uNsvltCatjbBNQcJfrJPCwK7G7wROtU6y7qU84cNai1ZUp8JZG_2LNWaDzIpsT9UzqZIapI23c7KvHwApfXciphr53qpJHOftRmfpde5_dfJwY4q7GwrUkmWFr2en0yKK5P1lTWchttXhtsX55sz70a91yTisvHURLHdIMrH4MGoU May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Domain-Id: None May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Domain-Name: None May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Identity-Status: Confirmed May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Is-Admin-Project: True May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Openstack-Nova-Api-Version: 2.90 May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Domain-Id: default May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Domain-Name: Default May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Name: admin May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Role: admin,member,reader May 23 20:16:13.643821 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Roles: admin,member,reader May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5277fd37f8044ad9345367a8cd3028d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}] May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant: admin May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant-Name: admin May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User: admin May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Domain-Id: default May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Domain-Name: Default May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Id: a03bfabd375944c7923bb6e092aa3498 May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Name: admin May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: method: > May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: exception: Flavor 42 could not be found. May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: action_args: {'id': '42'} May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:16:13.645497 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:13.646705 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:13.648217 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-66db1585-168e-41ef-b073-0a166ca9e592 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:16:13.649516 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-66db1585-168e-41ef-b073-0a166ca9e592 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063509 May 23 20:16:13.649516 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 20:16:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 20:16:13.655617 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-94e90f55-cd9b-498f-aec3-1527f411a59d admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:13.658557 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:16:13.676864 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-94e90f55-cd9b-498f-aec3-1527f411a59d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024723 May 23 20:16:13.677391 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 20:16:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:16:13.686771 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-8a909ac6-bc36-4630-bb64-c51406a9d20c admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:13.708349 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-8a909ac6-bc36-4630-bb64-c51406a9d20c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025134 May 23 20:16:13.713303 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 20:16:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:16:13.721396 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-cdbdddc3-f304-4fd4-a36a-097f05cc7b7a admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:13.727450 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.wsgi [None req-cdbdddc3-f304-4fd4-a36a-097f05cc7b7a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-cdbdddc3-f304-4fd4-a36a-097f05cc7b7a admin admin] Request method failure captured: May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Accept: application/json May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Accept-Encoding: gzip, deflate May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Connection: keep-alive May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Content-Length: 0 May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Host: 10.222.0.16 May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Openstack-Api-Version: compute 2.90 May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Openstack-System-Scope: None May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: User-Agent: python-novaclient May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Auth-Token: gAAAAABii-uNsvltCatjbBNQcJfrJPCwK7G7wROtU6y7qU84cNai1ZUp8JZG_2LNWaDzIpsT9UzqZIapI23c7KvHwApfXciphr53qpJHOftRmfpde5_dfJwY4q7GwrUkmWFr2en0yKK5P1lTWchttXhtsX55sz70a91yTisvHURLHdIMrH4MGoU May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Domain-Id: None May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Domain-Name: None May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Identity-Status: Confirmed May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Is-Admin-Project: True May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Openstack-Nova-Api-Version: 2.90 May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Domain-Id: default May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Domain-Name: Default May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Name: admin May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Role: admin,member,reader May 23 20:16:13.730780 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Roles: admin,member,reader May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5277fd37f8044ad9345367a8cd3028d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}] May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant: admin May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant-Name: admin May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User: admin May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Domain-Id: default May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Domain-Name: Default May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Id: a03bfabd375944c7923bb6e092aa3498 May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Name: admin May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: method: > May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: exception: Flavor 42 could not be found. May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: action_args: {'id': '42'} May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:16:13.732143 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:13.732945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:13.734385 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-cdbdddc3-f304-4fd4-a36a-097f05cc7b7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:16:13.735602 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-cdbdddc3-f304-4fd4-a36a-097f05cc7b7a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014383 May 23 20:16:13.735602 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 20:16:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 20:16:14.589888 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-8a909ac6-bc36-4630-bb64-c51406a9d20c admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:14.590900 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-8a909ac6-bc36-4630-bb64-c51406a9d20c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 May 23 20:16:14.591286 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:14.779281 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-6d037a5b-d863-4d5e-983b-31f6e3673ae8 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:14.785509 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.wsgi [None req-6d037a5b-d863-4d5e-983b-31f6e3673ae8 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-6d037a5b-d863-4d5e-983b-31f6e3673ae8 admin admin] Request method failure captured: May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Accept: application/json May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Accept-Encoding: gzip, deflate May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Connection: keep-alive May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Content-Length: 0 May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Host: 10.222.0.16 May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Openstack-Api-Version: compute 2.90 May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Openstack-System-Scope: None May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: User-Agent: python-novaclient May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Auth-Token: gAAAAABii-uOzrCeU1AUVBvk2JivcE8QvsVCfBR-HDpLPgdOc1I1YArro9JjicmEDg9FkdglcIPDY2x4DOtV59-vSrOtUmjEb_PDkuA8KZDKT6gv8LD6Zkm-QNzdYH0n0DeVObT-kcxSq5xaZclJO7ajJqOEaVswiDof5-mvqniyomHZ7-R7COg May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Domain-Id: None May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Domain-Name: None May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Identity-Status: Confirmed May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Is-Admin-Project: True May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Openstack-Nova-Api-Version: 2.90 May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Domain-Id: default May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Domain-Name: Default May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Name: admin May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Role: admin,member,reader May 23 20:16:14.787040 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Roles: admin,member,reader May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5277fd37f8044ad9345367a8cd3028d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}] May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant: admin May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant-Name: admin May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User: admin May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Domain-Id: default May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Domain-Name: Default May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Id: a03bfabd375944c7923bb6e092aa3498 May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Name: admin May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: method: > May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: exception: Flavor 84 could not be found. May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: action_args: {'id': '84'} May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:16:14.788619 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:14.789606 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:14.791028 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-6d037a5b-d863-4d5e-983b-31f6e3673ae8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:16:14.792291 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-6d037a5b-d863-4d5e-983b-31f6e3673ae8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061594 May 23 20:16:14.792291 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 20:16:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 20:16:14.798069 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-288764ac-63cb-4015-8566-284fcecda86b admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:14.813699 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-288764ac-63cb-4015-8566-284fcecda86b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019098 May 23 20:16:14.814177 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 20:16:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:16:14.824198 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-ca0447dd-8da8-4245-b837-1f10eb2c04d2 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:14.837733 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-ca0447dd-8da8-4245-b837-1f10eb2c04d2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017947 May 23 20:16:14.838275 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 20:16:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:16:14.847533 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-2dff0031-3b1f-4842-bd74-864b70c4dc5c admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:14.852728 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.wsgi [None req-2dff0031-3b1f-4842-bd74-864b70c4dc5c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-2dff0031-3b1f-4842-bd74-864b70c4dc5c admin admin] Request method failure captured: May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Accept: application/json May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Accept-Encoding: gzip, deflate May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Connection: keep-alive May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Content-Length: 0 May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Host: 10.222.0.16 May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Openstack-Api-Version: compute 2.90 May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Openstack-System-Scope: None May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: User-Agent: python-novaclient May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Auth-Token: gAAAAABii-uOzrCeU1AUVBvk2JivcE8QvsVCfBR-HDpLPgdOc1I1YArro9JjicmEDg9FkdglcIPDY2x4DOtV59-vSrOtUmjEb_PDkuA8KZDKT6gv8LD6Zkm-QNzdYH0n0DeVObT-kcxSq5xaZclJO7ajJqOEaVswiDof5-mvqniyomHZ7-R7COg May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Domain-Id: None May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Domain-Name: None May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Identity-Status: Confirmed May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Is-Admin-Project: True May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Openstack-Nova-Api-Version: 2.90 May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Domain-Id: default May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Domain-Name: Default May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Name: admin May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Role: admin,member,reader May 23 20:16:14.854284 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Roles: admin,member,reader May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5277fd37f8044ad9345367a8cd3028d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}] May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant: admin May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant-Name: admin May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User: admin May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Domain-Id: default May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Domain-Name: Default May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Id: a03bfabd375944c7923bb6e092aa3498 May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Name: admin May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: method: > May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: exception: Flavor 84 could not be found. May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: action_args: {'id': '84'} May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:16:14.855814 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:14.857032 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:14.858145 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-2dff0031-3b1f-4842-bd74-864b70c4dc5c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:16:14.859196 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-2dff0031-3b1f-4842-bd74-864b70c4dc5c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011621 May 23 20:16:14.859196 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Mon May 23 20:16:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 23 20:16:15.726673 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-ca0447dd-8da8-4245-b837-1f10eb2c04d2 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:15.727712 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-ca0447dd-8da8-4245-b837-1f10eb2c04d2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 23 20:16:15.728110 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:15.915645 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-92f048fb-0a34-4e2c-a1ea-c97a28bf3479 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:15.920940 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.wsgi [None req-92f048fb-0a34-4e2c-a1ea-c97a28bf3479 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-92f048fb-0a34-4e2c-a1ea-c97a28bf3479 admin admin] Request method failure captured: May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Accept: application/json May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Accept-Encoding: gzip, deflate May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Connection: keep-alive May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Content-Length: 0 May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Host: 10.222.0.16 May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Openstack-Api-Version: compute 2.90 May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Openstack-System-Scope: None May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: User-Agent: python-novaclient May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Auth-Token: gAAAAABii-uPYb2sBdC6_i8MskfQzFN3u7cV31LP_-xIcOIO36nAi8PkWCg5lRAVVUKn3QlbINzIF4p0mCZhVk4FUwsYIvOgRz7vcIprRc5Ygn-5T7E0BBvZPZQWMKYQtb39t1l0-wlq307KT7ydNdylXdHxgpQbBjoabMhM5mJSdgQKzfB50i0 May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Domain-Id: None May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Domain-Name: None May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Identity-Status: Confirmed May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Is-Admin-Project: True May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Openstack-Nova-Api-Version: 2.90 May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Domain-Id: default May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Domain-Name: Default May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Project-Name: admin May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Role: admin,member,reader May 23 20:16:15.922477 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Roles: admin,member,reader May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5277fd37f8044ad9345367a8cd3028d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}] May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant: admin May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-Tenant-Name: admin May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User: admin May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Domain-Id: default May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Domain-Name: Default May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Id: a03bfabd375944c7923bb6e092aa3498 May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: X-User-Name: admin May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: method: > May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: exception: Flavor 451 could not be found. May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: action_args: {'id': '451'} May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:16:15.923995 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:15.924876 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: ERROR nova.api.openstack.wsgi May 23 20:16:15.925977 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-92f048fb-0a34-4e2c-a1ea-c97a28bf3479 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:16:15.927043 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-92f048fb-0a34-4e2c-a1ea-c97a28bf3479 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060138 May 23 20:16:15.927043 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 20:16:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 20:16:15.933388 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-1add62ed-5e1a-40d9-8530-2ece7281a68a admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:15.948613 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-1add62ed-5e1a-40d9-8530-2ece7281a68a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018761 May 23 20:16:15.949126 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 20:16:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:16:15.958708 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:15.972483 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017722 May 23 20:16:15.973033 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Mon May 23 20:16:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:16:15.982171 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-a752f211-4486-4ba6-8e26-80a94a575f87 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:15.987461 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.wsgi [None req-a752f211-4486-4ba6-8e26-80a94a575f87 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-a752f211-4486-4ba6-8e26-80a94a575f87 admin admin] Request method failure captured: May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Accept: application/json May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Accept-Encoding: gzip, deflate May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Connection: keep-alive May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Content-Length: 0 May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Host: 10.222.0.16 May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Openstack-Api-Version: compute 2.90 May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Openstack-System-Scope: None May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: User-Agent: python-novaclient May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Auth-Token: gAAAAABii-uPYb2sBdC6_i8MskfQzFN3u7cV31LP_-xIcOIO36nAi8PkWCg5lRAVVUKn3QlbINzIF4p0mCZhVk4FUwsYIvOgRz7vcIprRc5Ygn-5T7E0BBvZPZQWMKYQtb39t1l0-wlq307KT7ydNdylXdHxgpQbBjoabMhM5mJSdgQKzfB50i0 May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Domain-Id: None May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Domain-Name: None May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Identity-Status: Confirmed May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Is-Admin-Project: True May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Openstack-Nova-Api-Version: 2.90 May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Domain-Id: default May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Domain-Name: Default May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Project-Name: admin May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Role: admin,member,reader May 23 20:16:15.988957 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Roles: admin,member,reader May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f5277fd37f8044ad9345367a8cd3028d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f5277fd37f8044ad9345367a8cd3028d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f5277fd37f8044ad9345367a8cd3028d"}]}] May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant: admin May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant-Id: f5277fd37f8044ad9345367a8cd3028d May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-Tenant-Name: admin May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User: admin May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Domain-Id: default May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Domain-Name: Default May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Id: a03bfabd375944c7923bb6e092aa3498 May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: X-User-Name: admin May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: method: > May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: exception: Flavor 451 could not be found. May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: action_args: {'id': '451'} May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:16:15.990507 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:15.991496 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: ERROR nova.api.openstack.wsgi May 23 20:16:15.992792 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-a752f211-4486-4ba6-8e26-80a94a575f87 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:16:15.994620 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-a752f211-4486-4ba6-8e26-80a94a575f87 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011704 May 23 20:16:15.994620 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 20:16:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 23 20:16:16.849987 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:16.851019 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 23 20:16:16.851428 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:17.039680 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-d2656399-ce92-4a25-adf9-5cee8c6158f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:16:17.157388 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-d2656399-ce92-4a25-adf9-5cee8c6158f4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.168447 May 23 20:16:17.157951 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 20:16:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:16:18.021099 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:18.022126 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 23 20:16:18.022519 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:18.209620 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-e555f2bc-12c6-4e3e-b8ea-982418e8dacd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:16:18.283601 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-e555f2bc-12c6-4e3e-b8ea-982418e8dacd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124303 May 23 20:16:18.284076 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 20:16:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:16:19.146842 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:19.147846 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 23 20:16:19.148242 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:19.333940 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-f47cb576-ad5e-4bf1-8c1c-373290454dd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:16:19.441692 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-f47cb576-ad5e-4bf1-8c1c-373290454dd5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.158096 May 23 20:16:19.442267 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 20:16:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:16:20.302453 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:20.303454 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 23 20:16:20.303888 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:20.491604 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-2aa2fbb1-9eae-45df-a295-eb23ef310de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:16:20.585743 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-2aa2fbb1-9eae-45df-a295-eb23ef310de9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.144829 May 23 20:16:20.586305 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Mon May 23 20:16:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:16:21.439083 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:21.440083 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 23 20:16:21.440476 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:16:21.628401 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-df50a40d-18fe-40dd-abdb-b0ebe171c2e9 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:16:21.648698 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-df50a40d-18fe-40dd-abdb-b0ebe171c2e9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072358 May 23 20:16:21.649453 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Mon May 23 20:16:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:17:23.065795 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:17:23.066842 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-1b8be820-f000-4210-bdf7-659ab0c081b7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 23 20:17:23.067238 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Mon May 23 20:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:17:23.075119 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:17:23.125891 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-c57879b2-1204-4508-8792-1c8df7afc37d admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:17:23.144729 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-c57879b2-1204-4508-8792-1c8df7afc37d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071100 May 23 20:17:23.145245 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Mon May 23 20:17:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:17:23.166473 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG dbcounter [-] [103736] Writing DB stats nova_api:SELECT=14 {{(pid=103736) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:17:23.170154 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-5be6eea9-eb31-4cd2-bbe4-7ab2120d503f admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:17:23.177578 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-5be6eea9-eb31-4cd2-bbe4-7ab2120d503f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012532 May 23 20:17:23.178370 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Mon May 23 20:17:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:17:23.189305 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-85d945b3-4795-4564-94a3-222d057e7d62 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:17:23.197314 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-85d945b3-4795-4564-94a3-222d057e7d62 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011652 May 23 20:17:23.197821 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Mon May 23 20:17:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:17:23.208589 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:17:23.217268 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012126 May 23 20:17:23.217794 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Mon May 23 20:17:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:17:23.230320 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-5c85b966-dbb9-408c-8a02-f63e2b391d80 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:17:23.237824 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-5c85b966-dbb9-408c-8a02-f63e2b391d80 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011090 May 23 20:17:23.238363 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Mon May 23 20:17:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:20:58.724306 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:20:58.725336 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 23 20:20:58.725724 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:20:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:20:58.884327 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_api:SELECT=6 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:20:59.001216 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-a0f2a425-ed5d-48ee-ab24-1b19214c472c admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:20:59.002418 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:20:59.002418 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: warnings.warn(msg) May 23 20:20:59.004258 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-a0f2a425-ed5d-48ee-ab24-1b19214c472c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:20:59.004694 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-a0f2a425-ed5d-48ee-ab24-1b19214c472c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:20:59.005493 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-a0f2a425-ed5d-48ee-ab24-1b19214c472c admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:20:59.005914 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-a0f2a425-ed5d-48ee-ab24-1b19214c472c admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:20:59.038949 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-a0f2a425-ed5d-48ee-ab24-1b19214c472c admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.156013 May 23 20:20:59.039505 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 20:20:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:20:59.918860 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:20:59.919865 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 23 20:20:59.920261 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:20:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:21:00.106926 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-5de64c2f-d442-46c6-b761-d14731a04bc4 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:21:00.108191 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:21:00.108191 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: warnings.warn(msg) May 23 20:21:00.109376 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-5de64c2f-d442-46c6-b761-d14731a04bc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:21:00.109798 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-5de64c2f-d442-46c6-b761-d14731a04bc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:21:00.110602 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-5de64c2f-d442-46c6-b761-d14731a04bc4 admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:21:00.111024 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-5de64c2f-d442-46c6-b761-d14731a04bc4 admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:21:00.130440 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-5de64c2f-d442-46c6-b761-d14731a04bc4 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.072329 May 23 20:21:00.130973 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 20:21:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:21:11.418009 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:21:11.419035 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 23 20:21:11.419430 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:21:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:21:11.561053 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_cell0:SELECT=4 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:21:11.561699 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_cell1:SELECT=4 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:21:11.562358 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG dbcounter [-] [103737] Writing DB stats nova_api:SELECT=8 {{(pid=103737) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:21:11.609525 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-0af8038b-65c5-48ea-8dd7-06648f7cfe87 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:21:11.610787 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:21:11.610787 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: warnings.warn(msg) May 23 20:21:11.611960 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-0af8038b-65c5-48ea-8dd7-06648f7cfe87 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:21:11.612406 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-0af8038b-65c5-48ea-8dd7-06648f7cfe87 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:21:11.613219 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-0af8038b-65c5-48ea-8dd7-06648f7cfe87 admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:21:11.613646 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-0af8038b-65c5-48ea-8dd7-06648f7cfe87 admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:21:11.637945 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-0af8038b-65c5-48ea-8dd7-06648f7cfe87 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081445 May 23 20:21:11.638512 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 20:21:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:21:12.500492 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: DEBUG nova.api.openstack.wsgi [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] Calling method '>' {{(pid=103736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:21:12.501492 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: INFO nova.api.openstack.requestlog [None req-4622637b-3e1d-4b6b-bb46-164ce1665a67 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 May 23 20:21:12.501893 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: [pid: 103736|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Mon May 23 20:21:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:21:12.688643 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG nova.api.openstack.wsgi [None req-ef72b7aa-c2f4-4d47-9ba9-cf48357765b8 admin admin] Calling method '>' {{(pid=103737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:21:12.689800 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 23 20:21:12.689800 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: warnings.warn(msg) May 23 20:21:12.691001 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ef72b7aa-c2f4-4d47-9ba9-cf48357765b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:21:12.691460 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ef72b7aa-c2f4-4d47-9ba9-cf48357765b8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:21:12.692225 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ef72b7aa-c2f4-4d47-9ba9-cf48357765b8 admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:21:12.692646 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: DEBUG oslo_concurrency.lockutils [None req-ef72b7aa-c2f4-4d47-9ba9-cf48357765b8 admin admin] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:21:12.713709 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: INFO nova.api.openstack.requestlog [None req-ef72b7aa-c2f4-4d47-9ba9-cf48357765b8 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076558 May 23 20:21:12.714274 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: [pid: 103737|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Mon May 23 20:21:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:22:08.379267 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: Mon May 23 20:22:08 2022 - graceful shutdown triggered... May 23 20:22:08.379385 dv-cinder-843018-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 23 20:22:08.380581 dv-cinder-843018-1-iscsi devstack@n-api.service[103736]: Gracefully killing worker 1 (pid: 103736)... May 23 20:22:08.380982 dv-cinder-843018-1-iscsi devstack@n-api.service[103737]: Gracefully killing worker 2 (pid: 103737)... May 23 20:22:09.381650 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: worker 1 buried after 1 seconds May 23 20:22:09.382129 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: worker 2 buried after 1 seconds May 23 20:22:09.382129 dv-cinder-843018-1-iscsi devstack@n-api.service[103735]: goodbye to uWSGI. May 23 20:22:09.383223 dv-cinder-843018-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 23 20:22:09.383815 dv-cinder-843018-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 23 20:22:09.386552 dv-cinder-843018-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 23 20:22:09.402461 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 23 20:22:09 2022] *** May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: nodename: dv-cinder-843018-1-iscsi May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: machine: x86_64 May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: clock source: unix May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: pcre jit disabled May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: detected number of CPU cores: 4 May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: current working directory: / May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: detected binary path: /usr/bin/uwsgi-core May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: your processes number limit is 47680 May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: your memory page size is 4096 bytes May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: detected max file descriptor number: 2048 May 23 20:22:09.425453 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: lock engine: pthread robust mutexes May 23 20:22:09.426605 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: thunder lock: enabled May 23 20:22:09.426605 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 23 20:22:09.426605 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 23 20:22:09.471651 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: Python main interpreter initialized at 0x556508b769c0 May 23 20:22:09.471651 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: python threads support enabled May 23 20:22:09.471651 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: your server socket listen backlog is limited to 100 connections May 23 20:22:09.471651 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: your mercy for graceful operations on workers is 90 seconds May 23 20:22:09.472084 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: mapped 403077 bytes (393 KB) for 2 cores May 23 20:22:09.472084 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: *** Operational MODE: preforking *** May 23 20:22:09.472333 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: *** uWSGI is running in multiple interpreter mode *** May 23 20:22:09.472333 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: spawned uWSGI master process (pid: 118152) May 23 20:22:09.472544 dv-cinder-843018-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 23 20:22:09.473148 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: spawned uWSGI worker 1 (pid: 118170, cores: 1) May 23 20:22:09.473503 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: spawned uWSGI worker 2 (pid: 118171, cores: 1) May 23 20:22:09.473620 dv-cinder-843018-1-iscsi devstack@n-api.service[118152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 23 20:22:10.652698 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 20:22:10.653294 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 23 20:22:11.443572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:22:11.443572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: from cryptography.utils import int_from_bytes May 23 20:22:11.443868 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:22:11.443868 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: from cryptography.utils import int_from_bytes May 23 20:22:11.444000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:22:11.444000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: from cryptography.utils import int_from_bytes May 23 20:22:11.444131 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 23 20:22:11.444131 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: from cryptography.utils import int_from_bytes May 23 20:22:13.853320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 20:22:13.853903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 20:22:13.854125 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 20:22:13.854490 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 20:22:13.854750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 20:22:13.855141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.855420 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 23 20:22:13.855800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.855895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 23 20:22:13.855989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.856086 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.856206 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 23 20:22:13.856405 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.856569 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 23 20:22:13.856719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.856833 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 23 20:22:13.857042 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.857203 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.857364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.857535 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.857700 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.857884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.857982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.858238 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.858355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.858572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.858680 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-1-iscsi {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.858887 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.858989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.859208 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.859309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.859528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.859639 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.859858 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.859964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.860119 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.860218 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.860437 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.860552 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.860759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843018-1-iscsi {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.860865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.861086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.861254 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.861378 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.861687 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.861805 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.861998 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.862195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.862352 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.862711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.862823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.862973 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.863097 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.863426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.863535 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.863761 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.863960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.864156 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.864346 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.864561 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.864759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.864943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.865140 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.865393 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.865645 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.865840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.866060 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-1-iscsi {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.866255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.866469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.866667 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.866862 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.867057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.867251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.867416 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.867616 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.867767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843018-1-iscsi {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.867943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.868085 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.868219 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.868394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.868523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.868657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.868798 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.868933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.869093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.869227 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.869361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.869503 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.869638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.869766 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.869905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.870069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.870214 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.870382 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.870519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.870655 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.870789 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.870928 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.871260 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.871408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.871546 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.871697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.871895 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.871895 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.872154 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.872282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.872417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.872552 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.872687 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.872816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.872992 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.873159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.873295 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.873429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.873586 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.873724 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.873866 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.873994 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.874236 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.874367 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.874501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.874638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.874793 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.874996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.875134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.875276 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.875413 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.875554 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.875690 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.875826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.875954 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.876093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.876234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.876368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.876503 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.876642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.876778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.876907 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.877118 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.877256 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.877387 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.877514 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.877648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.877776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.877916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.878077 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.878215 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.878355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.878491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.878491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.878742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.878871 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879132 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879266 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879411 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.879802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880307 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.880846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.881135 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.881415 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.881549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.881685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.881812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.881967 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.882113 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.882256 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.882418 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.882636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.882783 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.883016 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.883152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.883287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.883415 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.883550 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.883692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.883916 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.884047 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.884185 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.884320 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.884449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.884584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.884714 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.884884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885015 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885559 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885696 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885827 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.885954 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.886174 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.886332 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.886469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.886607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.886735 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.886871 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887008 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887008 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887257 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887257 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887782 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.887918 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.888053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.888181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.888315 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.888443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.888584 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.888721 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.888856 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.889024 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.889794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.889934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.890206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.890206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.890461 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.890598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.890732 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.890876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.891008 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.891151 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.891286 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.891583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.891718 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.891853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.891995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.892132 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.892261 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.892261 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.892512 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.892652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.892788 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.892922 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.893050 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.893189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.893324 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.893460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.893595 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.893755 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.893895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.894072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.894218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.894361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.894510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.894669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.894808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.894976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.895118 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.895298 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.895434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.895568 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.895710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.895847 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.895989 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.896157 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.896297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.896463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.896607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.896768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.896909 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.897073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.897204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.897376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.897507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.897674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.897814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.897996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.898149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.898337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.898480 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.898647 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.898792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.898954 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.899094 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.899263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.899402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.899569 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 23 20:22:13.899710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.899905 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.900045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.900243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.900385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.900557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.900694 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.900885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.901030 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.901199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.901339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.901519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.901654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.901836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.901954 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.902178 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.902300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.902499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.902615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.902829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.902932 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.903143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.903297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.903458 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.903671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.903815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.903944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.904079 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.904214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.904378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.904518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.905512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.905670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.905670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.905925 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.906090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.906232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.906369 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.906505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.906644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.906784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.906927 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.907063 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.907192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.907319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.907453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.907582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.907754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.907889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.908099 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.908245 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.908447 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.908593 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.908763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.908905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.909090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.909232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.909402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.909541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.909714 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.909852 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.910060 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.910208 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.910339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.910479 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.910656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.910788 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.910968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.911102 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.911280 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.911421 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.911678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.911908 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.912053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.912190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.912347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.912476 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.912610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.912746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.912881 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.913009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.913147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.913283 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.913419 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.913547 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.913723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.913861 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.914043 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.914192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.914358 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.914499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.914664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.914799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.914977 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.915109 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.915281 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.915412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.915591 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.915741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.915897 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.916037 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.916214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.916353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.916489 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.916630 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.916797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.916962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.917100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.917270 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.917408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.917546 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.917719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.917850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.918060 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.918209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.918372 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.918510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.918669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.918802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.918975 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.919116 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.919287 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.919421 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.919600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.919732 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.919905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.920045 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.920216 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.920375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.920547 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.920679 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.920851 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.920982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.921162 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.921295 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.921474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.921615 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.921765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.922077 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.922226 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.922355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.922489 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.922623 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.922757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.922893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.923026 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.923153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.923285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.923412 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.923590 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.923733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.923902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.924033 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.924215 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.924353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.924540 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.924683 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.924855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.924995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.925166 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.925303 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.925501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.925643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.925833 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.925964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.926234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.926373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.926514 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.926647 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.926775 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.926911 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.927045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.927171 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.927337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.927476 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.927644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.927776 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.927952 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.928090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.928259 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.928399 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.928562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.928698 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.928873 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.929003 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.929178 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.929316 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.929480 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.929616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.929784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.929925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.930110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.930249 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.930418 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.930549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.930740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.930948 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.931078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.931252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.931390 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.931519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.931654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.931798 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.931936 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.932236 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.932371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.932507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.932641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.932779 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.932915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.933045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.933180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.933309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.933500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.933641 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.933808 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.933939 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.934146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.934790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.934790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.935083 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.935280 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.935411 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.935539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.935667 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.935667 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.935925 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.936088 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.936232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.936368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.936497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.936497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.936758 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.936894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937023 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937023 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937264 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.937943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.938106 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.938246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.938381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.938510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.938638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.938767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.938902 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.939068 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.939209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.939375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.939516 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.939687 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.939829 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.939996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.940134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.940305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.940444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.940614 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.940758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.940925 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.941057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.941227 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.941360 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.941537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.941678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.941853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.941985 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.942189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.942325 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.942506 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.942628 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.942819 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.942936 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.943142 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.943245 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.943454 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.943549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.943768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.943870 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.944070 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.944163 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.944384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.944487 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.944691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.944783 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.945018 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.945122 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.945311 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.945406 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.945617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.945720 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.945928 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.946046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.946260 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.946366 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.946575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.946669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.946884 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.946986 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.947188 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.947290 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.947497 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.947598 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.947804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.947906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.948109 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.948204 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.948413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.948513 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.948740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.948937 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.949074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.949205 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.949334 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.949470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.949608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.949739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.949913 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.950100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.950244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.950381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.950541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.950674 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.950864 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.950996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.951180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.951320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.951483 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.952148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.952304 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.952540 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.952671 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.952806 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.952960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.953176 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.953318 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.953454 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.953583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.953742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.953872 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.954038 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.954168 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.954297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.954425 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.954571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.954747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.954930 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.955060 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.955213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.955343 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.955479 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.955656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.955788 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.955981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.956121 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.956293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.956440 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.956606 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.956745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.957181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.957331 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.957494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.957632 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.957810 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.957949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.958137 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.958279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.958446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.958587 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.958758 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.958896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.959071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.959204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.959377 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.959509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.959688 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.959825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.960007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.960144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.960355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.960583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.960740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.960917 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.961050 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.961224 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.961359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.961537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.962308 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.962308 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.962677 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.962822 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.962960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.963098 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.963327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.963470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.963600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.963742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.963881 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964158 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964425 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964555 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.964951 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.965088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.965088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.965342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.965473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.965614 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.965752 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.965881 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966304 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966433 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.966967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.967104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.967842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.967981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.968111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.968248 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.968388 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.968525 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.968656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.968784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.968913 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.969080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.969228 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.969389 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.969522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.969693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.969826 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.970002 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.970155 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.970332 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.970472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.970636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.970768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.970960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.971095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.971272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.971412 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.971577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.971718 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.971888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.972022 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.972194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.972328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.972531 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.972686 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.972895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.973034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.973174 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.973324 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.973534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.973684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.973822 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.973953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.974101 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.974231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.974359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.974500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.974637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.974767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.974944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.975130 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.975260 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.975401 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.975539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.975678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.975852 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.975994 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.976141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.976277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.976455 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.976595 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.976761 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.976894 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.977075 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.977218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.977385 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.977524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.977687 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.977819 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.977988 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.978155 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.978320 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.978454 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.978626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.978758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.978929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.979068 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.979238 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.979376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.979541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.979680 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.979842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.979980 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.980149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.980281 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.980454 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.980595 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.980754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.980884 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.981063 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.981195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.981365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.981509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.981666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.981804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.981977 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.982149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.982294 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.982496 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.982664 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.982793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.983022 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.983156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.983286 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.983423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.983574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.983791 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.983791 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.984118 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.984255 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.984386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.984386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.984643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.984778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.984915 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985052 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985181 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985315 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985445 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985708 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985845 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.985982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.986190 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.986345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.986879 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987026 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987157 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987294 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987425 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987563 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987707 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987846 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.987982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.988111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.988240 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.988368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.988542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.988695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.988695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.988942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.989078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.989209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.989337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.989543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.989682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.989812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.989941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.990120 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.990269 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.990401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.990537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.990667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.990803 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.990939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.991077 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.991207 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.991343 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.991472 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.991606 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.991752 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.991924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.992061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.992204 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.992341 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.992477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.992607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.992774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.992912 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.993126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.993273 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.993410 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.993547 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.993685 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.993836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.994082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.994217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.994348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.994490 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.994627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.994763 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.994917 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.995057 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.995230 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.995407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.995548 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.995685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.995821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.995965 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.996134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.996342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.996484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.996621 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.996758 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.996887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.997050 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.997200 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.997359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.997500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.997671 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.997812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.997975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.998180 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.998311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.998461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.998638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.998777 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.998949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.999082 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.999258 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.999400 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.999563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.999695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:13.999872 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.000012 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.000183 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.000315 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.000491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.000625 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.000801 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.000933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.001112 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.001248 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.001416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.001556 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.001729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.001870 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.002053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.002189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.002365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.002509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.002668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.002808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.002992 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.003124 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.003342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.003489 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.003626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.003762 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.003892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.004042 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.004252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.004395 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.004532 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.004671 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.004881 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.005012 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.005195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.005335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.005497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.005637 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.005800 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.005932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.006137 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.006273 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.006449 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.006594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.006763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.006903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.007079 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.007220 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.007384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.007519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.007711 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.007842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.008038 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.008179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.008344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.008485 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.008648 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.008790 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.009339 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.009477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.009609 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.009737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.009873 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010034 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010169 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010810 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.010940 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.011069 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.011197 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.011325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.011476 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.011620 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.011750 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.011878 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.012101 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.012299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.012442 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.012578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.012716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.012853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.013112 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.013247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.013468 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.013602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.013731 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.013859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.014053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.014805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.014950 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.015081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.015209 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.015338 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.015504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.015638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.015820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.015954 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.016131 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.016272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.016457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.016597 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.016775 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.016975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.017114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.017243 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.017381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.017510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.017677 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.017817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.017999 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.018278 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.018420 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.018565 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.018702 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.018839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.018970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.019108 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.019340 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.019473 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.019661 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.019801 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.019967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.020113 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.020275 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.020407 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.020602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.020734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.020906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.021048 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.021213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.021345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.021523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.021654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.021827 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.021966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.022160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.022304 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.022465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.022596 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.022788 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.022928 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.023092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.023225 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.023403 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.023615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.023757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.023887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.024016 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.024144 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.024297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.024438 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.024621 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.024776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.024992 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.025126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.025263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.025407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.025536 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.025671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.025831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.025952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.026138 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.026278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.026474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.026593 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.026780 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.026898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.027096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.027228 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.027404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.027529 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.027709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.027827 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.028014 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.028146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.028357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.028503 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.028662 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.028802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.028986 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.029120 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.029302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.029441 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.029635 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.030406 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.030552 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.030690 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.030820 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.030948 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.031109 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.031242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.031415 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.031556 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.031721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.031861 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.032026 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.032159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.032335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.032468 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.032637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.032778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.032940 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.033082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.033242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.033374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.033545 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.033759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.033893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.034056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.034201 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.034332 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.034461 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.034590 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.034747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.034890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.035040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.035257 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.035391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.035527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.035656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.035795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.035957 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.036091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.036268 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.036401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.036572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.036706 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.036879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.037019 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.037181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.037321 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.037522 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.037663 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.037826 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.037979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.038178 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.038309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.038481 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.038624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.038801 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.038943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.039120 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.039262 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.039432 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.039565 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.039752 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.039891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.040068 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.040209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.040378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.040516 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.040693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.040825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.041007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.041182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.041322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.041448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.041624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.041844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.041985 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.042206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.042341 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.042529 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.042662 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.042848 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.042989 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.043165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.043300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.043480 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.043696 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.043907 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.044054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.044192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.044322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.044458 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.044623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.044757 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.044937 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.045078 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.045254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.045380 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.045592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.045703 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.045907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.046050 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.046244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.046350 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.046555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.046666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.046871 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.046967 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.047202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.047297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.047526 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.047695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.047854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.047950 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.048191 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.048287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.048498 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.048602 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.048815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.048926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.049128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.049223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.049443 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.049549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.049759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.049856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.050094 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.050209 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.050413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.050510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.050727 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.050901 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.051051 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.051204 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.051339 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.051470 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.051636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.051777 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.051943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.052089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.052260 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.052402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.052569 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.052714 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.052880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.053028 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.053191 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.053325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.053505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.053646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.053818 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.054096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.054247 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.054392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.054529 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.054669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.054807 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.054987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.055164 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.055302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.055451 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.055663 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.055805 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.055934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.056209 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.056347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.056529 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.056673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.056851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.056987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.057158 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.057289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.057473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.057620 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.057784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.057914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.058113 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.058266 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.058442 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.058584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.058749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.058906 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.059043 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.059169 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.059357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.059496 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.059667 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.059805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.059975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.060199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.060345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.060549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.060680 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.060865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.061506 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.061709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.061856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.062062 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.062199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.062384 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.062599 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.062734 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.062956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.063091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.063276 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.063409 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.063589 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.063729 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.063904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.064059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.064271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.064416 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.064546 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.064684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.064822 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.064958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.065090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.065226 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.065398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.065541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.065685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.065901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.066058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.066204 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.066335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.066473 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.066602 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.066737 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.066920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.067061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.067225 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.067366 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.067528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.067660 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.067835 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.067966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.068139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.068273 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.068442 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.068581 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.068746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.068879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.069052 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.069199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.069344 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.069473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.069652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.069784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.069958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.070112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.070288 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.070432 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.070592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.070732 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.070886 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.071071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.071210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.071340 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.071490 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.071631 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.071802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.071935 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.072106 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.072246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.072417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.072564 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.072726 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.072859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.073034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.073172 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.073355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.073498 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.073667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.073808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.073979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.074148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.074303 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.074515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.074654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.074783 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.074911 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.075171 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.075349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.075506 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.075640 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.075816 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.076047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.076177 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.076316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.076451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.076598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.077302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.077544 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.077677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.077887 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.078045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.078219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.078352 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.078551 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.078687 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.078864 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.079005 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.079175 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.079306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.079478 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.079618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.079786 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.079924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.080102 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.080255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.081032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.081190 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.081330 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.081469 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.081608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.081738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.082145 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.082299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.082453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.082644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.082776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.082906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083176 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083176 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083822 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.083953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.084090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.084228 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.084359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.084503 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.084717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.084929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.085066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.085199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.085199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.085468 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.085606 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.085736 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.085874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086004 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086707 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086837 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086973 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.086973 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.087232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.087371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.087501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.087629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.087758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.087886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088029 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088166 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088295 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088558 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.088968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.089102 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.089268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.089402 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.089579 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.089721 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.089891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.090051 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.090239 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.090374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.090563 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.090705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.090878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.091012 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.091188 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.091329 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.091493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.091626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.091799 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.091932 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.092110 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.092272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.092456 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.092598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.092768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.092901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.093071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.093217 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.093376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.093517 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.093683 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.093814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.093986 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.094141 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.094316 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.094452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.094640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.094863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095141 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095270 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095440 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095704 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.095976 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.096112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.096261 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.096471 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.096613 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.096753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.096890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097028 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097158 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097429 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097559 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097696 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097832 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.097962 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.098140 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.098285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.098416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.098545 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.098720 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.098854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.099026 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.099175 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.099331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.099471 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.099639 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.099780 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.099943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.100084 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.100246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.100386 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.100547 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.100695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.100879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.101021 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.101199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.101331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.101515 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.101653 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.101827 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.101959 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.102161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.102301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.102486 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.102619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.102797 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.102939 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.103109 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.103249 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.103422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.103555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.103733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.103873 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.104043 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.104175 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.104356 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.104498 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.104675 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.104809 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.105027 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.105161 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.105290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.105428 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.105586 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.105727 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.105905 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.106074 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.106243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.106475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.106687 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.106820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.106957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.107095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.107238 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.107374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.107510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.107637 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.107773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.107926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.108115 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.108250 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.108428 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.108561 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.108740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.108872 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.109057 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.109198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.109375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.109515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.109688 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.109830 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.110007 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.110190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.110330 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.110461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.110646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.110789 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.110964 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.111104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.111283 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.111416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.111611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.111757 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.111939 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.112072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.112252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.112385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.112572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.112712 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.112886 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.113019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.113192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.113325 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.113467 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 20:22:14.113606 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.113869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.114298 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.114616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.115480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.115480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 23 20:22:14.115480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 23 20:22:14.172978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO dbcounter [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Registered counter for database nova_api May 23 20:22:14.174918 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO dbcounter [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Registered counter for database nova_api May 23 20:22:14.195271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.196859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_db.sqlalchemy.engines [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.203401 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writer thread running {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.204874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writer thread running {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.259526 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.context [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95806c6f-3d47-4566-84e6-920ffa618b20(cell1) {{(pid=118171) load_cells /opt/stack/nova/nova/context.py:464}} May 23 20:22:14.261153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.context [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95806c6f-3d47-4566-84e6-920ffa618b20(cell1) {{(pid=118170) load_cells /opt/stack/nova/nova/context.py:464}} May 23 20:22:14.263602 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:22:14.265767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:22:14.265916 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:22:14.266601 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:22:14.267534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:22:14.268340 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:22:14.268581 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:22:14.270422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:22:14.270611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO dbcounter [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Registered counter for database nova_cell0 May 23 20:22:14.272421 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO dbcounter [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Registered counter for database nova_cell0 May 23 20:22:14.274919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO dbcounter [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Registered counter for database nova_cell1 May 23 20:22:14.276844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO dbcounter [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Registered counter for database nova_cell1 May 23 20:22:14.282537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.283815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.286112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_db.sqlalchemy.engines [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.289141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_db.sqlalchemy.engines [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.290344 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writer thread running {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.292425 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writer thread running {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.295258 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writer thread running {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.300586 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writer thread running {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.444792 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO dbcounter [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Registered counter for database nova_cell0 May 23 20:22:14.445901 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO dbcounter [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Registered counter for database nova_cell0 May 23 20:22:14.452063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_db.sqlalchemy.engines [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.453668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_db.sqlalchemy.engines [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 23 20:22:14.460252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writer thread running {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.460724 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writer thread running {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 23 20:22:14.780636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: WARNING keystonemiddleware.auth_token [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:22:14.788374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: WARNING keystonemiddleware.auth_token [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:22:14.789597 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: WARNING keystonemiddleware.auth_token [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:22:14.798444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: WARNING keystonemiddleware.auth_token [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:22:15.132362 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: WARNING keystonemiddleware.auth_token [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:22:15.138347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: WARNING keystonemiddleware.auth_token [None req-30e93ef0-398f-4ab2-8fbc-6010d5a3b515 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:22:15.143653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556508b769c0 pid: 118171 (default app) May 23 20:22:15.148606 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: WARNING keystonemiddleware.auth_token [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 23 20:22:15.154602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: WARNING keystonemiddleware.auth_token [None req-a69fa541-9aea-460a-8efb-b0c96ba84466 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 23 20:22:15.160378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556508b769c0 pid: 118170 (default app) May 23 20:22:57.444483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:22:57.446467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:22:57.447347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:22:57.448386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:22:58.616477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2c1d91aa-de6d-4111-8abb-d3f3036b0f40 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Action: 'create', calling method: .version_select at 0x7f996f561c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-170193567"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:00.754791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2c1d91aa-de6d-4111-8abb-d3f3036b0f40 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.006830 May 23 20:23:00.754791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1154 bytes} [Mon May 23 20:22:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3016 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 20:23:00.759163 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=3 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:00.759163 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=3 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:00.759163 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=3 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:00.759163 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=3 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:00.763693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1893960160", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "networks": [{"uuid": "67dd9603-b898-4957-b227-ea3182295c01"}]}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:00.863090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] validate_networks() for [('67dd9603-b898-4957-b227-ea3182295c01', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:23:00.929931 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9405abb0-36d9-4f39-9378-3391832aaf96 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f530940>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:01.360270 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9405abb0-36d9-4f39-9378-3391832aaf96 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa" status: 200 len: 344 microversion: 2.1 time: 0.908036 May 23 20:23:01.362003 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 1/2] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:00 2022] GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa => generated 344 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:02.374453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f20c23ec-b4d7-4515-ae02-4905beeb1d49 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f3f9dc0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:02.512815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f20c23ec-b4d7-4515-ae02-4905beeb1d49 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa" status: 200 len: 345 microversion: 2.1 time: 0.143439 May 23 20:23:02.514160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:02 2022] GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:02.528754 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6a9d86a9-987e-4669-b786-daf26ded2020 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Action: 'create', calling method: .version_select at 0x7f996f3b7280>, body: {"snapshot": {"volume_id": "f1e30837-6965-4b56-b6d1-b7d237b7bfaa", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-990025649"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:03.295652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6a9d86a9-987e-4669-b786-daf26ded2020 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.774653 May 23 20:23:03.300961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 3/4] 10.222.0.16 () {60 vars in 1161 bytes} [Mon May 23 20:23:02 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:03.307064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5ea13664-438c-47e6-904b-5d5e8cbf3f3c tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f3f9af0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:03.350633 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5ea13664-438c-47e6-904b-5d5e8cbf3f3c tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 200 len: 286 microversion: 2.1 time: 0.048378 May 23 20:23:03.351196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 4/5] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:23:03 2022] GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:03.362475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8c435caf-4518-45dc-bfa8-59ca4aafd05d tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f3b78b0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:03.440731 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8c435caf-4518-45dc-bfa8-59ca4aafd05d tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.082617 May 23 20:23:03.442211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 5/6] 10.222.0.16 () {58 vars in 1139 bytes} [Mon May 23 20:23:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:03.457632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-eba97e0e-a900-48e8-8484-61d30d59f305 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f3b7f70>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:03.512356 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-eba97e0e-a900-48e8-8484-61d30d59f305 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 200 len: 286 microversion: 2.1 time: 0.060483 May 23 20:23:03.516281 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 6/7] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:23:03 2022] GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:04.384554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:23:04.385013 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:23:04.385545 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:23:04.386007 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:23:04.386500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:23:04.414959 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:04.421906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:04.422746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:04.423187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:04.524311 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8d2f3bf8-d31e-4667-9a51-7985cf458af4 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f3b7dc0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:04.537736 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Getting quotas for project 3c4adfd8b4c74448bd28b8d0bf149c0a. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:04.620367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Getting quotas for user 9a58140ac84841dca6ca68a4895abc8a and project 3c4adfd8b4c74448bd28b8d0bf149c0a. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:04.674715 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:23:04.680724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:23:04.808831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8d2f3bf8-d31e-4667-9a51-7985cf458af4 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 200 len: 286 microversion: 2.1 time: 0.289184 May 23 20:23:04.809897 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 7/8] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:23:04 2022] GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 286 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:05.008949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-92bf94b4-688f-48ff-b52f-e6137874e0a4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.501460 May 23 20:23:05.034598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 2/9] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:23:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 4528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:23:05.047313 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bbf5662b-e7bd-4454-9ff4-5eee681c449b tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:05.053964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bbf5662b-e7bd-4454-9ff4-5eee681c449b tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:05.351166 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bbf5662b-e7bd-4454-9ff4-5eee681c449b tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:05.391966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bbf5662b-e7bd-4454-9ff4-5eee681c449b tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1215 microversion: 2.1 time: 0.374960 May 23 20:23:05.393254 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 8/10] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:05 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1215 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:05.823600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6e778311-7e1b-4ef7-8ab2-504f5440f458 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996eac6700>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:05.901410 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6e778311-7e1b-4ef7-8ab2-504f5440f458 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 200 len: 286 microversion: 2.1 time: 0.083526 May 23 20:23:05.904177 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 3/11] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:23:05 2022] GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:06.409945 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cf82b068-d088-454f-a547-189adf07a0a9 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:06.410770 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cf82b068-d088-454f-a547-189adf07a0a9 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:06.483136 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-831e7701-fac6-4f96-87d5-d4214533d3af tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'create', calling method: .version_select at 0x7f996f530940>, body: {"keypair": {"name": "tempest-keypair-442869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBU6OAnTHW972Mj1kOEZk9nqfUoh4ihT+TxCaiUWxJcl1/gq4Z2FNHMz0DYztbvwVnJjBkSw+IVaFkS5MHSJYJJjcwQylvQsx1QYASUiBWyyy5FoedvDxLgdJQmVns6XTw=="}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:06.629139 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-831e7701-fac6-4f96-87d5-d4214533d3af tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for project 39849cec37754352a6822cd57277b954. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:06.636924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-831e7701-fac6-4f96-87d5-d4214533d3af tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for user 0a19c51d287046578e9e4016784dad8f and project 39849cec37754352a6822cd57277b954. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:06.802642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-831e7701-fac6-4f96-87d5-d4214533d3af tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.557951 May 23 20:23:06.803841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 9/12] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:23:06 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:06.915437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c2e3f0cc-4c6e-4b1d-89f7-18ee150afd10 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f2e5ca0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:06.984103 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c2e3f0cc-4c6e-4b1d-89f7-18ee150afd10 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 200 len: 287 microversion: 2.1 time: 0.072387 May 23 20:23:06.985324 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 10/13] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:23:06 2022] GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:06.994933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f12b8a5e-43b6-42af-8149-df0e90dfd567 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f2e5e50>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:07.215870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f12b8a5e-43b6-42af-8149-df0e90dfd567 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 202 len: 0 microversion: 2.1 time: 0.224239 May 23 20:23:07.216972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 11/14] 10.222.0.16 () {58 vars in 1253 bytes} [Mon May 23 20:23:06 2022] DELETE /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 20:23:07.226032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-aa79749a-d012-4fe4-a163-b563413ea0b1 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f3180d0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:07.280417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-aa79749a-d012-4fe4-a163-b563413ea0b1 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 200 len: 286 microversion: 2.1 time: 0.058472 May 23 20:23:07.281317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 12/15] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:23:07 2022] GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:07.316426 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cf82b068-d088-454f-a547-189adf07a0a9 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:07.344898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cf82b068-d088-454f-a547-189adf07a0a9 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1215 microversion: 2.1 time: 0.936151 May 23 20:23:07.345995 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 4/16] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:06 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1215 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:08.292153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7c1a6600-e068-488b-a7fa-dfca76cf5ec2 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996f318820>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:08.321246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-7c1a6600-e068-488b-a7fa-dfca76cf5ec2 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] HTTP exception thrown: Snapshot de46f4bc-a734-445d-8165-3ccc79f6936d could not be found. May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7c1a6600-e068-488b-a7fa-dfca76cf5ec2 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Request method failure captured: May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d HTTP/1.1 May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0hNpEPcin0PExzBtPjGp28NnF8t-gwxXbrLxEI_hDqdJDlFMmcKbdEW8gr5NjdLbg-pSkC-jv4hcC555ApbY5XGZBleA5SR9beLDqFcIzKKVQ90AC1RVW9L0HNKCrFh5Bnad-86B4RM8ArBWo76-h75jP4EvhP_OIqSZcqGE4WJN8 May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:23:08.328047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d69eb4f1edc049e9bbca2b0ad51feb26", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}] May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 2b655558f6e44de98f1fedb84a4d5839 May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Snapshot de46f4bc-a734-445d-8165-3ccc79f6936d could not be found. May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'de46f4bc-a734-445d-8165-3ccc79f6936d'} May 23 20:23:08.329126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot de46f4bc-a734-445d-8165-3ccc79f6936d could not be found. (HTTP 404) (Request-ID: req-41775d9d-7136-423d-961b-0f4c0a65c30c) May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:08.329743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:23:08.330618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot de46f4bc-a734-445d-8165-3ccc79f6936d could not be found. May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 23 20:23:08.331742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot de46f4bc-a734-445d-8165-3ccc79f6936d could not be found. May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot de46f4bc-a734-445d-8165-3ccc79f6936d could not be found. May 23 20:23:08.332686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:08.337102 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7c1a6600-e068-488b-a7fa-dfca76cf5ec2 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Returning 404 to user: Snapshot de46f4bc-a734-445d-8165-3ccc79f6936d could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:23:08.337919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7c1a6600-e068-488b-a7fa-dfca76cf5ec2 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d" status: 404 len: 111 microversion: 2.1 time: 0.049989 May 23 20:23:08.342567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 13/17] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:23:08 2022] GET /compute/v2.1/os-snapshots/de46f4bc-a734-445d-8165-3ccc79f6936d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:23:08.359177 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-520ac393-3b83-48e0-a9ac-e37cad4aeb63 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996eaddd30>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:08.373307 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:08.374761 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:08.384310 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:08.393953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:08.393953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:08.393953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:08.637693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:08.651443 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-23972232-d05e-4b38-98c6-48b545b7c735 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1219 microversion: 2.1 time: 0.285357 May 23 20:23:08.652475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 14/18] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:08 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1219 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:08.722836 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-520ac393-3b83-48e0-a9ac-e37cad4aeb63 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa" status: 202 len: 0 microversion: 2.1 time: 0.375464 May 23 20:23:08.723618 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 5/19] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:23:08 2022] DELETE /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 20:23:08.731877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-af968458-223f-4096-8e80-ac599d6709d0 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996e9fac10>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:08.817815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-af968458-223f-4096-8e80-ac599d6709d0 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa" status: 200 len: 344 microversion: 2.1 time: 0.089734 May 23 20:23:08.818606 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 15/20] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:08 2022] GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa => generated 344 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:09.671872 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:09.672507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:09.690663 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:09.692507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:09.695270 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:09.695895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:09.837387 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c8b86320-212e-4f3e-9c1c-e33767b7aa9a tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996ea11550>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:09.910867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-c8b86320-212e-4f3e-9c1c-e33767b7aa9a tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] HTTP exception thrown: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c8b86320-212e-4f3e-9c1c-e33767b7aa9a tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Request method failure captured: May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa HTTP/1.1 May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0hNpEPcin0PExzBtPjGp28NnF8t-gwxXbrLxEI_hDqdJDlFMmcKbdEW8gr5NjdLbg-pSkC-jv4hcC555ApbY5XGZBleA5SR9beLDqFcIzKKVQ90AC1RVW9L0HNKCrFh5Bnad-86B4RM8ArBWo76-h75jP4EvhP_OIqSZcqGE4WJN8 May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:23:09.913647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d69eb4f1edc049e9bbca2b0ad51feb26", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}] May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 2b655558f6e44de98f1fedb84a4d5839 May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'f1e30837-6965-4b56-b6d1-b7d237b7bfaa'} May 23 20:23:09.919222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. (HTTP 404) (Request-ID: req-6e25a849-a54a-4eab-bb94-63334e4cd507) May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:09.919924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:23:09.920778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 20:23:09.921637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c8b86320-212e-4f3e-9c1c-e33767b7aa9a tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Returning 404 to user: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c8b86320-212e-4f3e-9c1c-e33767b7aa9a tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa" status: 404 len: 109 microversion: 2.1 time: 0.086613 May 23 20:23:09.922602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 16/21] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:09 2022] GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:23:09.929020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-470286e0-bcba-4921-a078-b0558bad4ea7 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996e9fa820>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:10.066134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-470286e0-bcba-4921-a078-b0558bad4ea7 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] HTTP exception thrown: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-470286e0-bcba-4921-a078-b0558bad4ea7 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Request method failure captured: May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa HTTP/1.1 May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0hNpEPcin0PExzBtPjGp28NnF8t-gwxXbrLxEI_hDqdJDlFMmcKbdEW8gr5NjdLbg-pSkC-jv4hcC555ApbY5XGZBleA5SR9beLDqFcIzKKVQ90AC1RVW9L0HNKCrFh5Bnad-86B4RM8ArBWo76-h75jP4EvhP_OIqSZcqGE4WJN8 May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:23:10.068105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d69eb4f1edc049e9bbca2b0ad51feb26", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}] May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 2b655558f6e44de98f1fedb84a4d5839 May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'f1e30837-6965-4b56-b6d1-b7d237b7bfaa'} May 23 20:23:10.069198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. (HTTP 404) (Request-ID: req-50e6623f-7aaa-4d78-af6a-c78a9fe7f54f) May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:10.069839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 20:23:10.071602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 20:23:10.072497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-470286e0-bcba-4921-a078-b0558bad4ea7 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Returning 404 to user: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-470286e0-bcba-4921-a078-b0558bad4ea7 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa" status: 404 len: 109 microversion: 2.1 time: 0.144505 May 23 20:23:10.075322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 17/22] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:23:09 2022] DELETE /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 20:23:10.091081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5826b647-03d3-4b4d-a2a9-fd498e186824 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Calling method '.version_select at 0x7f996ea825e0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:10.120732 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:10.134957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-5826b647-03d3-4b4d-a2a9-fd498e186824 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] HTTP exception thrown: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5826b647-03d3-4b4d-a2a9-fd498e186824 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Request method failure captured: May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa HTTP/1.1 May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0hNpEPcin0PExzBtPjGp28NnF8t-gwxXbrLxEI_hDqdJDlFMmcKbdEW8gr5NjdLbg-pSkC-jv4hcC555ApbY5XGZBleA5SR9beLDqFcIzKKVQ90AC1RVW9L0HNKCrFh5Bnad-86B4RM8ArBWo76-h75jP4EvhP_OIqSZcqGE4WJN8 May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:23:10.136896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d69eb4f1edc049e9bbca2b0ad51feb26", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d69eb4f1edc049e9bbca2b0ad51feb26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d69eb4f1edc049e9bbca2b0ad51feb26"}]}] May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: d69eb4f1edc049e9bbca2b0ad51feb26 May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-9410329 May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 2b655558f6e44de98f1fedb84a4d5839 May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesSnapshotsTestJSON-9410329-project May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'f1e30837-6965-4b56-b6d1-b7d237b7bfaa'} May 23 20:23:10.138739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. (HTTP 404) (Request-ID: req-3ee78cf0-69b1-4461-b823-50b68b67cb88) May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:10.139460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:23:10.140449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 20:23:10.141448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5826b647-03d3-4b4d-a2a9-fd498e186824 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] Returning 404 to user: Volume f1e30837-6965-4b56-b6d1-b7d237b7bfaa could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5826b647-03d3-4b4d-a2a9-fd498e186824 tempest-VolumesSnapshotsTestJSON-9410329 tempest-VolumesSnapshotsTestJSON-9410329-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa" status: 404 len: 109 microversion: 2.1 time: 0.061122 May 23 20:23:10.142526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 18/23] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:10 2022] GET /compute/v2.1/os-volumes/f1e30837-6965-4b56-b6d1-b7d237b7bfaa => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:23:10.147631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-32ba6562-3ad2-4470-9436-1985b867de89 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1267 microversion: 2.1 time: 0.480159 May 23 20:23:10.148212 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 6/24] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:09 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1267 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:11.164562 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:11.165177 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:11.180441 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:11.180896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:11.181683 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:11.182275 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:11.372027 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:11.384009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9bbb522e-5592-4598-befd-af3431a98706 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1273 microversion: 2.1 time: 0.223127 May 23 20:23:11.387712 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 19/25] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:11 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:12.412490 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:12.413708 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:12.445422 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:12.445422 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:12.445422 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:12.445422 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:13.192227 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:13.200935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dab616a3-3f55-48ae-825a-8897f3d74a86 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1273 microversion: 2.1 time: 0.793649 May 23 20:23:13.225428 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 7/26] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:12 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1273 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:14.239199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:14.239846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:14.259937 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:14.260399 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:14.261187 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:14.261624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:14.466346 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:14.586696 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:14.598035 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a676f025-be8d-43a5-895a-75a43ec58e12 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1273 microversion: 2.1 time: 0.363156 May 23 20:23:14.613375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 20/27] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:14 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1273 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:15.057280 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-99695bd0-8657-45bd-aa2c-6dd7d18d241e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: .version_select at 0x7f996e1a6d30>, body: {"keypair": {"name": "tempest-keypair-1361845096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/Jjma7yWdnjY01QDqCobNvJNyQmShJa/rhcJwu7oUoEFG3ZozeGhE+YYoiaT1285y774CZFc3DIuJSQLJb32ndZeWxj0Yn3ifOU57qB5/qoDXOQbAyoauuZAZ5F1dliw=="}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:15.139134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-99695bd0-8657-45bd-aa2c-6dd7d18d241e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:15.150247 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-99695bd0-8657-45bd-aa2c-6dd7d18d241e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:15.249108 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-497092311", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4da5b57-d47b-4357-af5e-3630e836e52a"}], "security_groups": [{"name": "tempest-securitygroup--510439963"}], "key_name": "tempest-keypair-442869", "user_data": "}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:15.391756 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-99695bd0-8657-45bd-aa2c-6dd7d18d241e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.078131 May 23 20:23:15.392759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 8/28] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:23:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:15.621519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:15.622884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:15.666947 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:15.671934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:15.671934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:15.671934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:15.763741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] validate_networks() for [('e4da5b57-d47b-4357-af5e-3630e836e52a', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:23:16.655652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=6 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:17.257334 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:17.289983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e5c9c8bf-532e-423b-93c8-4eddfe591c75 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 1.667835 May 23 20:23:17.293059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 9/29] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:15 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:18.310480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:18.311184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:18.323813 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:18.325774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:18.328776 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:18.330934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:18.445340 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:23:18.445841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:23:18.446325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:23:18.447425 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:23:18.448668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:23:18.471390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:18.471919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:18.481525 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:18.482069 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:18.614604 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for project 39849cec37754352a6822cd57277b954. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:18.633326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for user 0a19c51d287046578e9e4016784dad8f and project 39849cec37754352a6822cd57277b954. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:18.682664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:23:18.688430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:23:18.988347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3497c8a7-5922-4618-bba4-7d067f659a9a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.756481 May 23 20:23:18.994370 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 21/30] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:23:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 3764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:23:19.000026 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-18f1f57f-eed9-4548-b459-99945f631143 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e951550>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:19.208533 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-18f1f57f-eed9-4548-b459-99945f631143 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/a5ce37f1-4107-423a-b9f0-2e50c9c21e3d" status: 200 len: 350 microversion: 2.1 time: 0.212705 May 23 20:23:19.209853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 22/31] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:18 2022] GET /compute/v2.1/os-volumes/a5ce37f1-4107-423a-b9f0-2e50c9c21e3d => generated 350 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:19.233895 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0881045a-b524-4ff7-8b8e-5cb3fa7b657c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:19.235188 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0881045a-b524-4ff7-8b8e-5cb3fa7b657c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:19.407561 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:19.415793 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e1d7e766-9578-434c-bf86-4084432415f0 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 1.110142 May 23 20:23:19.420601 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 10/32] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:18 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:19.493032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0881045a-b524-4ff7-8b8e-5cb3fa7b657c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:19.501431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0881045a-b524-4ff7-8b8e-5cb3fa7b657c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1233 microversion: 2.1 time: 0.289957 May 23 20:23:19.521553 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 23/33] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:19 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1233 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:20.441198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:20.442527 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:20.452615 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:20.456570 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:20.457623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:20.458848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:20.539064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a21d736e-79ca-41dd-9745-734612e329f9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:20.539664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a21d736e-79ca-41dd-9745-734612e329f9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:20.682934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a21d736e-79ca-41dd-9745-734612e329f9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:20.690418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a21d736e-79ca-41dd-9745-734612e329f9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1233 microversion: 2.1 time: 0.155411 May 23 20:23:20.693759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 24/34] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:20 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1233 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:21.636090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:21.658097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-98a21c32-a72b-4c0a-a068-cdd8e7ef5b85 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 1.220003 May 23 20:23:21.660754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 11/35] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:20 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:21.709095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:21.710621 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:21.724651 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:21.741067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:21.743880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:21.744524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:21.931751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cd8a2841-6521-49be-bc40-531288154650 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e1d20d0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:22.123457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:22.141859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-31dc36ea-e454-44a8-af6a-7eb49d6a6f0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1237 microversion: 2.1 time: 0.431663 May 23 20:23:22.143586 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 25/36] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:21 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1237 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:22.155500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cd8a2841-6521-49be-bc40-531288154650 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/1597d997-b509-4afd-bc59-c7d252c72855" status: 200 len: 350 microversion: 2.1 time: 0.228359 May 23 20:23:22.156863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 12/37] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:21 2022] GET /compute/v2.1/os-volumes/1597d997-b509-4afd-bc59-c7d252c72855 => generated 350 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:22.365778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1903339494", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e834b06-191b-4f74-93c9-403bb39ced80"}], "security_groups": [{"name": "tempest-securitygroup--1137165148"}], "key_name": "tempest-keypair-1361845096", "user_data": "}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:22.442941 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-eb9a7c18-5dc7-4f79-ba4a-9081b2054ad8 req-326db242-3fa6-4b7f-968a-1b687e4bdfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ecf2ba5-daf8-4535-9e28-5ee169593895", "tag": "cd556b35-e6cf-468e-aa39-ceba38437792"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:22.484761 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-eb9a7c18-5dc7-4f79-ba4a-9081b2054ad8 req-326db242-3fa6-4b7f-968a-1b687e4bdfef service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:22.485499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-eb9a7c18-5dc7-4f79-ba4a-9081b2054ad8 req-326db242-3fa6-4b7f-968a-1b687e4bdfef service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:22.514999 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-eb9a7c18-5dc7-4f79-ba4a-9081b2054ad8 req-326db242-3fa6-4b7f-968a-1b687e4bdfef service nova] Creating event network-changed:cd556b35-e6cf-468e-aa39-ceba38437792 for instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 on hv-cinder-84301 May 23 20:23:22.515977 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-eb9a7c18-5dc7-4f79-ba4a-9081b2054ad8 req-326db242-3fa6-4b7f-968a-1b687e4bdfef service nova] Acquired lock "compute-rpcapi-router" {{(pid=118170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 20:23:22.517607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a9409617-8203-4c97-9bb5-3482a3ba738c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:22.518321 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a9409617-8203-4c97-9bb5-3482a3ba738c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:22.519339 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a9409617-8203-4c97-9bb5-3482a3ba738c None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:22.519996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a9409617-8203-4c97-9bb5-3482a3ba738c None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:22.539397 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.compute.rpcapi [None req-a9409617-8203-4c97-9bb5-3482a3ba738c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 20:23:22.540531 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a9409617-8203-4c97-9bb5-3482a3ba738c None None] Releasing lock "compute-rpcapi-router" {{(pid=118170) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 20:23:22.578944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a9409617-8203-4c97-9bb5-3482a3ba738c None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.433784 May 23 20:23:22.579550 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 26/38] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:22.695998 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:22.713768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:22.730919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:22.733770 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:22.737702 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:22.738407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:22.864477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] validate_networks() for [('2e834b06-191b-4f74-93c9-403bb39ced80', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:23:23.134312 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:23.142472 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3c4fdd71-df9e-41cd-926c-81e84b16d414 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.458260 May 23 20:23:23.149597 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 27/39] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:22 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:23.363141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9f55f83a-8b7c-4dc8-b880-13e8f9baf27c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'create', calling method: .version_select at 0x7f996d8f60d0>, body: {"keypair": {"name": "tempest-keypair-258098076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJl9uGNk4qb2LUtI3dhz3Gb7FPldX51KLKNooCWmwmlFc3AY2So5kfYTHCanQ6gMzWaRqauyE1h3MeeAH92lugDj1aijJ3C87jWfMdBZIQc1IF9qiRSoNjmW3/K5rdDqCg=="}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:23.425558 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-9f55f83a-8b7c-4dc8-b880-13e8f9baf27c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:23.441034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-9f55f83a-8b7c-4dc8-b880-13e8f9baf27c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for user c4586fdc3e8b4ee0ab58d8c236637a4f and project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:23.602052 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9f55f83a-8b7c-4dc8-b880-13e8f9baf27c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.449845 May 23 20:23:23.604569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 28/40] 10.222.0.16 () {62 vars in 1199 bytes} [Mon May 23 20:23:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 454 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 23 20:23:23.612539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:23.612539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:23.673649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:23.676160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:23.677222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:23.678658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:23.872353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:23.883941 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1b95efaa-e9b3-4f7f-9d75-04ea40d3c469 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1303 microversion: 2.1 time: 0.278449 May 23 20:23:23.885249 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 29/41] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:23 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1303 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:24.041885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1540366189", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:24.177099 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] validate_networks() for [('9b05af20-bb00-474e-91be-5942b9baa0f0', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:23:25.182616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=12 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:25.882918 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:23:25.883332 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:23:25.883823 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:23:25.884277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:23:25.884754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:23:25.922068 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:25.922546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:25.923565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:25.924035 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:25.990437 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:26.004693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:26.036114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:23:26.038434 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:23:26.110324 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:23:26.111520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:23:26.112214 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:23:26.112932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:23:26.113771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:23:26.143973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:26.144866 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:26.145722 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:26.150779 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:26.223894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:26.245572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for user feb66e681a894c148e3463ff5a0dd1be and project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:26.245999 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-622d00ed-84b0-48e6-a18e-93a6771c1a94 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.879777 May 23 20:23:26.252273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 13/42] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:23:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 3888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 20:23:26.265240 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:26.266430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:26.290289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:26.293548 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:26.294603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:26.298200 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:26.299754 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:23:26.304808 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:23:26.540860 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7feb924a-c851-444a-989b-62fdb2b8dceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.654222 May 23 20:23:26.552967 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 30/43] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:23:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:23:26.565700 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9131bdfe-f8bb-4cc2-9b5a-d7e62d26371a tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996d8f69d0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:26.750519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9131bdfe-f8bb-4cc2-9b5a-d7e62d26371a tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cd80adb6-f818-41ae-982c-45e2bb1003c2" status: 200 len: 350 microversion: 2.1 time: 0.195857 May 23 20:23:26.751678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 31/44] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:23:26 2022] GET /compute/v2.1/os-volumes/cd80adb6-f818-41ae-982c-45e2bb1003c2 => generated 350 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:26.758052 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:26.758812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:26.785211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:26.786445 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:26.790750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:26.795753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:27.040109 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:27.059516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-52d56d93-f808-4630-8635-b16dc37ab330 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1291 microversion: 2.1 time: 0.305498 May 23 20:23:27.061854 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 32/45] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:26 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1291 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:27.075252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f9374a1f-3279-45da-9b0c-a1309294babe tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:27.101061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f9374a1f-3279-45da-9b0c-a1309294babe tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:27.128289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:27.136988 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-86202669-274c-4a18-9c1e-97247aa23f10 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.887645 May 23 20:23:27.145123 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 14/46] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:26 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:27.159580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b6662da3-641a-440d-96bd-87c7c1025865 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:27.165726 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b6662da3-641a-440d-96bd-87c7c1025865 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:27.331721 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b6662da3-641a-440d-96bd-87c7c1025865 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:27.339326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b6662da3-641a-440d-96bd-87c7c1025865 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1222 microversion: 2.1 time: 0.192333 May 23 20:23:27.352127 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 15/47] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:27 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:27.368170 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-298a3366-2778-4f93-b8f0-2973187f3b70 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e173700>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:27.579668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-298a3366-2778-4f93-b8f0-2973187f3b70 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.226238 May 23 20:23:27.580777 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 16/48] 10.222.0.16 () {58 vars in 1133 bytes} [Mon May 23 20:23:27 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:27.596668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-930abfd1-72a4-46c2-8901-24f6a959e6fa tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e19caf0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:27.753409 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f9374a1f-3279-45da-9b0c-a1309294babe tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:27.767730 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f9374a1f-3279-45da-9b0c-a1309294babe tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1242 microversion: 2.1 time: 0.703774 May 23 20:23:27.800491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 33/49] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:27 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1242 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:27.823336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-581983713", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:27.946058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] validate_networks() for [('9b05af20-bb00-474e-91be-5942b9baa0f0', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:23:27.957535 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-930abfd1-72a4-46c2-8901-24f6a959e6fa tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.368189 May 23 20:23:27.958713 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 17/50] 10.222.0.16 () {58 vars in 1148 bytes} [Mon May 23 20:23:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:27.980665 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1503b129-afbc-490c-9865-438afc1ae409 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996fd40040>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:28.213465 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1503b129-afbc-490c-9865-438afc1ae409 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.246206 May 23 20:23:28.221243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 18/51] 10.222.0.16 () {58 vars in 1133 bytes} [Mon May 23 20:23:27 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:28.226184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:28.226818 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:28.228687 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:28.246110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:28.246551 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:28.247320 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:28.247768 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:28.269360 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=41 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:28.885284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:28.898072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a2e82909-2b7d-41aa-a00b-8d13c6f70fcc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.675591 May 23 20:23:28.902581 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 19/52] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:28 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:28.911955 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:28.919995 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:28.941813 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:28.942548 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:28.943603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:28.944288 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:29.528373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:23:29.530063 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:23:29.530708 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:23:29.531135 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:23:29.531569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:23:29.542389 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:29.543406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:29.544232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:29.544697 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:29.630360 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:29.636965 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for user feb66e681a894c148e3463ff5a0dd1be and project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:29.645855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:29.649747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:29.661801 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:23:29.665944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:23:29.678436 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-260df5d6-9b59-4007-8dea-e135d33ce3fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.773317 May 23 20:23:29.688833 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 20/53] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:28 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:29.697070 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d00e7b93-b693-4e6b-8828-73be2e942b99 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e1b5c10>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:29.987925 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5292b5ce-9043-4005-9189-c8ff4c913cc3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.182135 May 23 20:23:29.997814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 34/54] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:23:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:23:30.021359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:30.021359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:30.033668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:30.039681 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:30.040462 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:30.040912 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:30.041859 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d00e7b93-b693-4e6b-8828-73be2e942b99 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.351440 May 23 20:23:30.046548 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 21/55] 10.222.0.16 () {58 vars in 1166 bytes} [Mon May 23 20:23:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:30.047015 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:30.047803 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:30.066592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:30.067414 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:30.071062 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:30.075000 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:30.225050 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:30.273460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7774d105-680d-48f3-8062-e6fa23897c71 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1246 microversion: 2.1 time: 0.262125 May 23 20:23:30.278455 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 35/56] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:29 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1246 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:30.287516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fbddcc48-5184-4f86-9b32-0bbf0e47975f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:30.302874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-fbddcc48-5184-4f86-9b32-0bbf0e47975f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:30.558417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fbddcc48-5184-4f86-9b32-0bbf0e47975f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:30.565864 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-fbddcc48-5184-4f86-9b32-0bbf0e47975f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1221 microversion: 2.1 time: 0.285322 May 23 20:23:30.579678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 36/57] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:30 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1221 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:30.596995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d9b724cb-adfd-44cb-bf8c-bb688d4a0ebd tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996d8feaf0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:30.766390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d9b724cb-adfd-44cb-bf8c-bb688d4a0ebd tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.185494 May 23 20:23:30.766969 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 37/58] 10.222.0.16 () {58 vars in 1169 bytes} [Mon May 23 20:23:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:30.771746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:30.773867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:30.790756 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:30.791204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:30.791983 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:30.792421 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:31.042642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:31.051261 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1042f618-cfb4-4267-a54e-83b0b7b713c6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 1.007737 May 23 20:23:31.059868 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 22/59] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:30 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:31.074384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e77bff28-228d-4899-aec3-1e5b0d9a298f tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e1df820>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:31.298971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e77bff28-228d-4899-aec3-1e5b0d9a298f tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.237990 May 23 20:23:31.306569 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 23/60] 10.222.0.16 () {58 vars in 1154 bytes} [Mon May 23 20:23:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:31.315590 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:31.324444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:31.347531 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:31.351668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:31.353775 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:31.354621 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:31.509467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:31.522387 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-457b9752-1b9c-420d-9e0d-5ca76083f578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1238 microversion: 2.1 time: 0.213161 May 23 20:23:31.529321 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:31.540539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 24/61] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:31 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1238 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:31.544823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-28f5e8ee-786c-4dfb-8b4c-73e1b00d343d tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.776783 May 23 20:23:31.545411 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 38/62] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:30 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:31.554120 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-677090a8-7c60-4085-94ab-731ce86f56b8 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e173790>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:31.753280 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-8a404b3d-79ee-46b0-891a-4458a33b18ee req-977a52e7-1e7b-476e-89a7-783b4bd7bba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f258da-266e-4cb0-8c76-5a3329d1fdc5", "tag": "9991b679-f7be-400d-a65d-c38eece74bbe"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:31.761714 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-8a404b3d-79ee-46b0-891a-4458a33b18ee req-977a52e7-1e7b-476e-89a7-783b4bd7bba6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:31.762649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-8a404b3d-79ee-46b0-891a-4458a33b18ee req-977a52e7-1e7b-476e-89a7-783b4bd7bba6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:31.781153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-8a404b3d-79ee-46b0-891a-4458a33b18ee req-977a52e7-1e7b-476e-89a7-783b4bd7bba6 service nova] Creating event network-changed:9991b679-f7be-400d-a65d-c38eece74bbe for instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 on hv-cinder-84301 May 23 20:23:31.799602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-8a404b3d-79ee-46b0-891a-4458a33b18ee req-977a52e7-1e7b-476e-89a7-783b4bd7bba6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245320 May 23 20:23:31.800518 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 39/63] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:31.806748 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:31.810977 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:31.828470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:31.828931 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:31.829723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:31.830210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:31.939179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-677090a8-7c60-4085-94ab-731ce86f56b8 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.393692 May 23 20:23:31.939179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 25/64] 10.222.0.16 () {58 vars in 1187 bytes} [Mon May 23 20:23:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:31.955289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dfde565f-1431-4dce-88ac-f1c4032e0ff4 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] Calling method '.version_select at 0x7f996e1dfca0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:31.969111 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:31.977410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3f2139c4-433f-468f-95e6-807988b2e09c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1225 microversion: 2.1 time: 0.174929 May 23 20:23:31.977988 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 40/65] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:31 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1225 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:32.036979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2093786755", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8643c6ef-a04e-42d5-acb9-668f5c2b5666"}], "security_groups": [{"name": "tempest-securitygroup--1020686835"}], "key_name": "tempest-keypair-258098076", "user_data": "}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:32.104316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dfde565f-1431-4dce-88ac-f1c4032e0ff4 tempest-VolumesTestJSON-232364415 tempest-VolumesTestJSON-232364415-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.155458 May 23 20:23:32.104316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 26/66] 10.222.0.16 () {58 vars in 1154 bytes} [Mon May 23 20:23:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:32.107535 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:32.109221 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:32.115030 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.127097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.132765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.132765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.198534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] validate_networks() for [('8643c6ef-a04e-42d5-acb9-668f5c2b5666', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:23:32.361828 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:32.371779 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6b049562-e75e-4a18-a271-ac06def9b685 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.268189 May 23 20:23:32.372703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 27/67] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:32 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:32.546985 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:32.547758 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:32.559943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.560678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.561804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.562484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.676905 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:32.687006 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-070b3638-2db4-48e5-8d5a-df5f9389a1c0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1302 microversion: 2.1 time: 0.150597 May 23 20:23:32.688394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 28/68] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:32 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:32.695809 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:32.696632 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:32.704701 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.705994 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.707003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.707582 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.899006 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:23:32.899432 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:23:32.899875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:23:32.900279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:23:32.900685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:23:32.911328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.912063 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.913057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:32.913310 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:32.913938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:32.932343 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=73 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:32.937193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-97a79e4d-ae31-4a79-b1d5-8762bb11d687 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.247473 May 23 20:23:32.937787 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 29/69] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:32 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:32.957216 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:23:32.962160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for user c4586fdc3e8b4ee0ab58d8c236637a4f and project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:23:32.982629 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:23:32.986811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:23:32.995449 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:32.997019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:33.005588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.006562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:33.007705 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.008770 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:33.140519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:33.151413 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ea47b3ff-1178-4f84-8f72-f5ce84ff74fb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1273 microversion: 2.1 time: 0.160318 May 23 20:23:33.164140 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 30/70] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:32 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:33.187960 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0ee7436d-84ed-4066-95a9-5ec5ff1a81ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.155507 May 23 20:23:33.188788 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 41/71] 10.222.0.16 () {62 vars in 1187 bytes} [Mon May 23 20:23:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 23 20:23:33.199080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2125345c-5d55-48cb-9aac-8297030185cb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:33.199686 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2125345c-5d55-48cb-9aac-8297030185cb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:33.270079 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2125345c-5d55-48cb-9aac-8297030185cb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:33.283903 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2125345c-5d55-48cb-9aac-8297030185cb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:33.285825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2125345c-5d55-48cb-9aac-8297030185cb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:33.287278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2125345c-5d55-48cb-9aac-8297030185cb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1281 microversion: 2.20 time: 0.092254 May 23 20:23:33.288143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 31/72] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:33 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:33.389677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:33.390617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:33.397607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.398159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:33.399150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.399751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:33.558450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:33.566194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-110fc343-7fb1-4033-9393-7f4496d78360 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.181244 May 23 20:23:33.567985 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 42/73] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:33 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:33.706174 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:33.706810 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:33.715259 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.715950 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:33.716915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.720024 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:33.878584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:33.905167 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1bca6c48-2b9d-4662-b441-0d3f281e73b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1312 microversion: 2.1 time: 0.204366 May 23 20:23:33.905943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 32/74] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:33 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:33.965495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:33.965495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:33.971424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.974607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:33.977913 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:33.979563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:34.174521 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:34.182309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:34.194970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:34.201699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:34.204249 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:34.206925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:34.340024 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:34.361021 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ecf2cd74-2c7c-4020-9c78-882dff6b203f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1291 microversion: 2.1 time: 0.188465 May 23 20:23:34.363543 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 33/75] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:34 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1291 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:34.374389 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fd643cc5-7714-4a0b-9de3-1f885b493064 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:34.374794 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fd643cc5-7714-4a0b-9de3-1f885b493064 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:34.444034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:34.459499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f6e0fd53-45d5-4dd6-bdf1-987685e967e6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.506121 May 23 20:23:34.461890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 43/76] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:33 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:34.584992 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:34.585715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:34.601184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:34.601184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:34.601184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:34.601184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:34.668880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fd643cc5-7714-4a0b-9de3-1f885b493064 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:34.680304 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fd643cc5-7714-4a0b-9de3-1f885b493064 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:34.684828 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fd643cc5-7714-4a0b-9de3-1f885b493064 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:34.686272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fd643cc5-7714-4a0b-9de3-1f885b493064 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1281 microversion: 2.20 time: 0.321477 May 23 20:23:34.694992 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 34/77] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:34 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1281 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:34.923035 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:34.923874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:34.951044 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:34.951514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:34.952316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:34.952749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:35.178259 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:35.188583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f4cfa231-90d7-4cf7-9169-e14db35569bb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.607821 May 23 20:23:35.190535 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 44/78] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:34 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:35.378828 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:35.382677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:35.383302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:35.391116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:35.391796 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:35.393445 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:35.393727 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bc6231e7-b5c9-4e05-81e6-be84918c4cb4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.475344 May 23 20:23:35.394236 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:35.394344 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 35/79] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:34 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:35.478302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:35.479124 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:35.493192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:35.493818 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:35.496850 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:35.497231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:35.497814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:35.506940 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0b5de87b-321f-437c-96d7-bc5e2537b739 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1279 microversion: 2.1 time: 0.128284 May 23 20:23:35.508221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 45/80] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:35 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1279 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:35.705852 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:35.706806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:35.716194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:35.717353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:35.717730 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:35.718247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:35.821812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:35.835454 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:35.839007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:35.841028 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b265ac43-2ffb-4ef9-85a1-3a8722afad7a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1333 microversion: 2.20 time: 0.140114 May 23 20:23:35.842225 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 46/81] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:35 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1333 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:35.965074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:36.098946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:36.119102 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8b085bc8-feca-4c62-ab6d-eb4f3732b4e7 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.645983 May 23 20:23:36.120566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 36/82] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:35 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:36.207819 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:36.209086 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:36.221040 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:36.223661 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:36.223661 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:36.223661 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:36.415519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:36.421557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:36.435646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:36.436402 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:36.437390 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:36.438062 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:36.980559 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:36.989571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a69b098d-04a4-4961-bca9-e0ca340ee060 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.785808 May 23 20:23:36.991309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 47/83] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:36 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:36.997628 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-2cc6f00f-68d9-4c48-9eed-11441873ad6d req-048d81e8-7bcf-469d-b059-5e1777aac05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4058a126-dae4-43c7-8270-12ea57ea38c6", "tag": "7c6e7dea-7110-4e10-8314-3048e5eb1884"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:37.008552 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-2cc6f00f-68d9-4c48-9eed-11441873ad6d req-048d81e8-7bcf-469d-b059-5e1777aac05e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.008986 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-2cc6f00f-68d9-4c48-9eed-11441873ad6d req-048d81e8-7bcf-469d-b059-5e1777aac05e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:37.021602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-2cc6f00f-68d9-4c48-9eed-11441873ad6d req-048d81e8-7bcf-469d-b059-5e1777aac05e service nova] Creating event network-changed:7c6e7dea-7110-4e10-8314-3048e5eb1884 for instance 4058a126-dae4-43c7-8270-12ea57ea38c6 on hv-cinder-84301 May 23 20:23:37.027326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-2cc6f00f-68d9-4c48-9eed-11441873ad6d req-048d81e8-7bcf-469d-b059-5e1777aac05e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034601 May 23 20:23:37.027919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 48/84] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:37.034427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:37.037464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:37.041758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.042763 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:37.043520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.043950 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:37.131557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:37.142466 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ddc4387b-68e1-4d0e-bbf8-328cbb04f904 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.735763 May 23 20:23:37.143495 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 37/85] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:36 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:37.170195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:37.171909 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:37.194572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.194572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:37.194572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.194572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:37.369724 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:37.379568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-861b6efb-6f1e-4c67-b2c4-e507adca4cc9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.350386 May 23 20:23:37.380784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 49/86] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:37 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:37.386522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:37.387526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:37.394567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.395221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:37.396150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.396762 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:37.405032 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:37.417156 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:37.424533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:37.426046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f91a8575-fee0-4aaf-bdd4-aef6d8cc9c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1339 microversion: 2.20 time: 0.278768 May 23 20:23:37.429432 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 38/87] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:37 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:37.791081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:37.803893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4e0503d8-5912-49cc-99e0-c7aab5bcd128 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.421823 May 23 20:23:37.814064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 50/88] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:37 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:37.967029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-108d5e09-9096-4b31-a1b2-f9cfd7033d44 req-af25d1ae-cd65-4077-bb96-566e9679646b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecf2ba5-daf8-4535-9e28-5ee169593895", "name": "network-vif-plugged", "status": "completed", "tag": "cd556b35-e6cf-468e-aa39-ceba38437792"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:37.994447 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-108d5e09-9096-4b31-a1b2-f9cfd7033d44 req-af25d1ae-cd65-4077-bb96-566e9679646b service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:37.994447 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-108d5e09-9096-4b31-a1b2-f9cfd7033d44 req-af25d1ae-cd65-4077-bb96-566e9679646b service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.007729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:38.008996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:38.024547 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.025239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.028689 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.029300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.057114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-108d5e09-9096-4b31-a1b2-f9cfd7033d44 req-af25d1ae-cd65-4077-bb96-566e9679646b service nova] Creating event network-vif-plugged:cd556b35-e6cf-468e-aa39-ceba38437792 for instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 on hv-cinder-84301 May 23 20:23:38.058745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-108d5e09-9096-4b31-a1b2-f9cfd7033d44 req-af25d1ae-cd65-4077-bb96-566e9679646b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 23 20:23:38.061337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-10acb9fc-be2b-4429-b4a5-09d09d53b4cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.061817 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-10acb9fc-be2b-4429-b4a5-09d09d53b4cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.063829 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-10acb9fc-be2b-4429-b4a5-09d09d53b4cc None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.064269 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-10acb9fc-be2b-4429-b4a5-09d09d53b4cc None None] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.100837 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.compute.rpcapi [None req-10acb9fc-be2b-4429-b4a5-09d09d53b4cc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 23 20:23:38.101756 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-10acb9fc-be2b-4429-b4a5-09d09d53b4cc None None] Releasing lock "compute-rpcapi-router" {{(pid=118171) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 23 20:23:38.137924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-10acb9fc-be2b-4429-b4a5-09d09d53b4cc None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270804 May 23 20:23:38.138879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 39/89] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:38.162880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:38.163953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:38.172061 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.172815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.173734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.174345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.483774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:38.493997 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6da498a9-8cce-44a9-be54-799750543fe8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.339337 May 23 20:23:38.498204 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 40/90] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:38 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:38.519083 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:38.520564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:38.528379 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.529061 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.530225 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.531098 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.585332 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:38.596289 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1a37bfe6-f073-4810-b6d9-8f667456b406 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.588975 May 23 20:23:38.597103 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 51/91] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:38 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:38.605465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:38.609941 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:38.622142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.622410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.630502 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.634345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.781853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:38.791059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f78d4f33-c024-484e-b81a-9b1fe80cc8bf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.291511 May 23 20:23:38.791666 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 41/92] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:38 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:38.820771 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:38.821579 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:38.828900 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.829346 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.835337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:38.835815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:38.844210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:38.983991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:38.998141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:39.000180 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:39.001600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-980fc896-37f1-4658-8ec6-3c29b8811bb2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.403408 May 23 20:23:39.014717 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 52/93] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:38 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:39.020406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-fe195f74-1746-4e0a-bc49-0d0d6f15b75d req-7a23736c-0cd8-4fb9-902d-13d4a2b4224f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "881652d5-5df9-43a8-b417-afe21877e7f2", "tag": "d0965418-0eb9-41f9-bd9a-a071392128fb"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:39.029865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-fe195f74-1746-4e0a-bc49-0d0d6f15b75d req-7a23736c-0cd8-4fb9-902d-13d4a2b4224f service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.030634 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-fe195f74-1746-4e0a-bc49-0d0d6f15b75d req-7a23736c-0cd8-4fb9-902d-13d4a2b4224f service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:39.057388 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-fe195f74-1746-4e0a-bc49-0d0d6f15b75d req-7a23736c-0cd8-4fb9-902d-13d4a2b4224f service nova] Creating event network-changed:d0965418-0eb9-41f9-bd9a-a071392128fb for instance 881652d5-5df9-43a8-b417-afe21877e7f2 on hv-cinder-84301 May 23 20:23:39.068786 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-fe195f74-1746-4e0a-bc49-0d0d6f15b75d req-7a23736c-0cd8-4fb9-902d-13d4a2b4224f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052263 May 23 20:23:39.070290 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 53/94] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:39.104096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-f5a8cff4-7fb2-457c-ab76-a98aa96c00d5 req-6d30ea1b-6e03-44fa-9e3f-208ec6823281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e99c75-f555-4442-9cb8-9b296d90b049", "tag": "b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:39.136269 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f5a8cff4-7fb2-457c-ab76-a98aa96c00d5 req-6d30ea1b-6e03-44fa-9e3f-208ec6823281 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.138686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f5a8cff4-7fb2-457c-ab76-a98aa96c00d5 req-6d30ea1b-6e03-44fa-9e3f-208ec6823281 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:39.184620 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-f5a8cff4-7fb2-457c-ab76-a98aa96c00d5 req-6d30ea1b-6e03-44fa-9e3f-208ec6823281 service nova] Creating event network-changed:b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e for instance 81e99c75-f555-4442-9cb8-9b296d90b049 on hv-cinder-84301 May 23 20:23:39.200411 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-f5a8cff4-7fb2-457c-ab76-a98aa96c00d5 req-6d30ea1b-6e03-44fa-9e3f-208ec6823281 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100264 May 23 20:23:39.204756 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 54/95] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:39.210359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:39.223280 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f87f8636-29ea-42a9-9ae5-5d11fa8682f4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.406327 May 23 20:23:39.230148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 42/96] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:38 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:39.514390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:39.514917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:39.521726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.522311 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:39.523253 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.523679 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:39.613493 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:39.614187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:39.625753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.626271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:39.627097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.628110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:39.682486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:39.696582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f83ba5da-8187-47cc-b436-2df513cfb33b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.187653 May 23 20:23:39.697401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 55/97] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:39 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:39.788683 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:39.796244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-235744d4-1803-45eb-af86-5a6fe48fab5d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.186951 May 23 20:23:39.799700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 43/98] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:39 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:39.811424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:39.812026 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:39.817921 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.818388 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:39.819135 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:39.819564 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:40.026096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:40.026740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:40.039039 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:40.039665 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:40.040456 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:40.040877 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:40.304302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:40.312664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e58e8b8d-b736-44cc-bfd7-1536cd4efbf8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.505213 May 23 20:23:40.313159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 56/99] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:39 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:40.325229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-f27a5082-43db-4a7a-bdc3-0f97947ba13b req-557479c6-87e9-4bc7-8936-c520c9a829a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f258da-266e-4cb0-8c76-5a3329d1fdc5", "name": "network-vif-plugged", "status": "completed", "tag": "9991b679-f7be-400d-a65d-c38eece74bbe"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:40.334520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f27a5082-43db-4a7a-bdc3-0f97947ba13b req-557479c6-87e9-4bc7-8936-c520c9a829a7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:40.336138 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f27a5082-43db-4a7a-bdc3-0f97947ba13b req-557479c6-87e9-4bc7-8936-c520c9a829a7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:40.348171 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-f27a5082-43db-4a7a-bdc3-0f97947ba13b req-557479c6-87e9-4bc7-8936-c520c9a829a7 service nova] Creating event network-vif-plugged:9991b679-f7be-400d-a65d-c38eece74bbe for instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 on hv-cinder-84301 May 23 20:23:40.353996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-f27a5082-43db-4a7a-bdc3-0f97947ba13b req-557479c6-87e9-4bc7-8936-c520c9a829a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032676 May 23 20:23:40.358353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 57/100] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:40.372573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:40.373289 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:40.424545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:40.425023 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:40.430709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:40.434427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:40.721846 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:40.734506 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:40.735966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:40.737103 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-eb29f662-eaa8-4a49-9cea-21eb5745ef73 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.715082 May 23 20:23:40.737666 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 44/101] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:40 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:23:40.752731 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:40.753682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:40.760440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:40.761727 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:40.762800 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:40.763434 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.099053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:41.111686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a2b74dfe-0d34-4e11-a08b-035b6274612a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.750885 May 23 20:23:41.112114 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 58/102] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:40 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:41.117963 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:41.119151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:41.127644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:41.128332 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.129573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:41.130656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.335419 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:41.339967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-27a7cfcd-d83d-431f-8161-5069669cd512 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.591366 May 23 20:23:41.343159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 45/103] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:40 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:41.363214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:41.365458 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:41.379447 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:41.381483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.387029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:41.387484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.430360 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:41.439223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1269c7d2-01c2-40d7-95e4-c3b11adf7c06 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.325605 May 23 20:23:41.440064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 59/104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:41 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:41.629652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:41.639662 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-996a3fb6-2570-42f9-920e-e7061ef73387 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.293196 May 23 20:23:41.640697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 46/105] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:41 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:41.754949 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:41.755237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:41.761282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:41.761725 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.762515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:41.762946 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.886196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-6633a8b5-2ea0-45c7-a22f-20823dd0f1ee req-cbb89200-5b9e-4243-9d66-a6cf8e35c406 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d11af6-2834-47d4-92cc-ee3135a9f976", "tag": "f9e2fedd-ed41-4d66-9fcb-34b45c5b6538"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:41.904447 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-6633a8b5-2ea0-45c7-a22f-20823dd0f1ee req-cbb89200-5b9e-4243-9d66-a6cf8e35c406 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:41.905273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-6633a8b5-2ea0-45c7-a22f-20823dd0f1ee req-cbb89200-5b9e-4243-9d66-a6cf8e35c406 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:41.918375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-6633a8b5-2ea0-45c7-a22f-20823dd0f1ee req-cbb89200-5b9e-4243-9d66-a6cf8e35c406 service nova] Creating event network-changed:f9e2fedd-ed41-4d66-9fcb-34b45c5b6538 for instance 27d11af6-2834-47d4-92cc-ee3135a9f976 on hv-cinder-84301 May 23 20:23:41.923901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-6633a8b5-2ea0-45c7-a22f-20823dd0f1ee req-cbb89200-5b9e-4243-9d66-a6cf8e35c406 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047804 May 23 20:23:41.924669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 47/106] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:41.966173 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:41.975389 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:41.978165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:41.980685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6fcce0b3-4ea5-4db3-b3cb-4c962b725afb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.228834 May 23 20:23:41.982309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 60/107] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:41 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:42.141613 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:42.142550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:42.151528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.151528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.151528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.151528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.298557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:42.306958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4cc86639-6258-47de-b66a-489e06bcf751 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.173300 May 23 20:23:42.308646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 48/108] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:42 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:42.360501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:42.361719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:42.377746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.378335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.379115 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.380197 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.384818 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:42.460709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:42.462133 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:42.473962 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.474861 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.476239 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.477541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.674210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:42.686879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-da53e4bf-ff67-40e1-976f-4b484f227874 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1358 microversion: 2.1 time: 0.232023 May 23 20:23:42.693555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 49/109] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:42 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:42.698860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:42.701110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:42.713019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.717181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.718408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.719036 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:42.933443 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=10 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:42.971073 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=36 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:42.974050 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:42.982195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4f270062-1154-49b5-8038-305bd6c2be4d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.291019 May 23 20:23:42.983106 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 50/110] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:42 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:42.988293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-d4cfb5fd-61d8-4703-97d1-f983659204e2 req-c6eec059-c430-4624-b91d-9e228d181065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4058a126-dae4-43c7-8270-12ea57ea38c6", "name": "network-vif-plugged", "status": "completed", "tag": "7c6e7dea-7110-4e10-8314-3048e5eb1884"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:42.997287 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-d4cfb5fd-61d8-4703-97d1-f983659204e2 req-c6eec059-c430-4624-b91d-9e228d181065 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:42.998001 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-d4cfb5fd-61d8-4703-97d1-f983659204e2 req-c6eec059-c430-4624-b91d-9e228d181065 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.009938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-d4cfb5fd-61d8-4703-97d1-f983659204e2 req-c6eec059-c430-4624-b91d-9e228d181065 service nova] Creating event network-vif-plugged:7c6e7dea-7110-4e10-8314-3048e5eb1884 for instance 4058a126-dae4-43c7-8270-12ea57ea38c6 on hv-cinder-84301 May 23 20:23:43.017539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-d4cfb5fd-61d8-4703-97d1-f983659204e2 req-c6eec059-c430-4624-b91d-9e228d181065 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033037 May 23 20:23:43.020486 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 51/111] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:43.026046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:43.027594 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:43.034246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.034972 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.035936 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.036523 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.132750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:43.142723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7033e059-6a5f-4c5f-ac66-f671bc1a0e4b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.786256 May 23 20:23:43.152127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 61/112] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:42 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:43.257546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:43.274711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:43.277794 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:43.279415 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b5a7d421-4b56-4d1c-a663-6d3932c30801 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.257468 May 23 20:23:43.280179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 52/113] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:43 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:43.324156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:43.324762 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:43.331600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.332041 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.332869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.333296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.472566 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:43.480378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-197755f9-c09a-4826-aa84-b62e015c6317 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1315 microversion: 2.1 time: 0.160697 May 23 20:23:43.480948 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 62/114] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:43 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:43.708275 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:43.708950 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:43.715670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.716111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.719611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.719611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.855496 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:43.865619 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f35c083f-c139-46f7-91bf-a92c2fa767e0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1544 microversion: 2.1 time: 0.161279 May 23 20:23:43.866862 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 53/115] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:43 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1544 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:43.885698 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c1cfaec7-3926-4ffd-a83d-188ac1cecc0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:43.886583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c1cfaec7-3926-4ffd-a83d-188ac1cecc0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:43.893428 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1cfaec7-3926-4ffd-a83d-188ac1cecc0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.893964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1cfaec7-3926-4ffd-a83d-188ac1cecc0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:43.894982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1cfaec7-3926-4ffd-a83d-188ac1cecc0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:43.895495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1cfaec7-3926-4ffd-a83d-188ac1cecc0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.000125 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:44.000741 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:44.006988 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.007441 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.008205 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.008649 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.152499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c1cfaec7-3926-4ffd-a83d-188ac1cecc0d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.271316 May 23 20:23:44.153081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 63/116] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:23:43 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:44.163483 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:44.164373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:44.177767 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.183644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.184467 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.184914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.232674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:44.249915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8903a69c-7f63-495a-928c-fea874c27960 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.254357 May 23 20:23:44.250588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 54/117] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:43 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:44.298374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:44.299214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:44.314167 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.314718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.316040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.318178 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.555070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:44.562943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a272e721-1d0f-4604-b287-db01d21297cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.406584 May 23 20:23:44.567917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 64/118] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:44 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:44.573126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:44.574430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:44.581079 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.581814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.582791 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:44.583398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:44.674435 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=12 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:44.732316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:44.747891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:44.750243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:44.752640 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e8042739-49f6-411f-9d05-168abc02978a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.458187 May 23 20:23:44.767780 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 55/119] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:44 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:23:45.003146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:45.014210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4da086ec-ccf9-4a9b-9f6f-611cc4fb82ba tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1502 microversion: 2.1 time: 0.444939 May 23 20:23:45.026770 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 65/120] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:44 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1502 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:45.098285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-9030c8a5-0014-4226-8902-4e7f50c4335e req-5df11833-b48f-48fd-bfd4-2600069efdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e99c75-f555-4442-9cb8-9b296d90b049", "name": "network-vif-plugged", "status": "completed", "tag": "b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:45.112139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-9030c8a5-0014-4226-8902-4e7f50c4335e req-5df11833-b48f-48fd-bfd4-2600069efdd9 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:45.112999 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-9030c8a5-0014-4226-8902-4e7f50c4335e req-5df11833-b48f-48fd-bfd4-2600069efdd9 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:45.151900 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-9030c8a5-0014-4226-8902-4e7f50c4335e req-5df11833-b48f-48fd-bfd4-2600069efdd9 service nova] Creating event network-vif-plugged:b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e for instance 81e99c75-f555-4442-9cb8-9b296d90b049 on hv-cinder-84301 May 23 20:23:45.165776 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-9030c8a5-0014-4226-8902-4e7f50c4335e req-5df11833-b48f-48fd-bfd4-2600069efdd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071776 May 23 20:23:45.169732 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 56/121] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:45.268863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:45.269670 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:45.280006 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:45.280510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:45.281341 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:45.281851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:45.433714 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:45.442753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8ffe3699-2c94-47f8-b870-c87e085809f4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.178823 May 23 20:23:45.443719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 66/122] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:45 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:45.582967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:45.584478 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:45.594965 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:45.596025 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:45.596826 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:45.597440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:45.777044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:45.778769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:45.790134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:45.793475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:45.795014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:45.795686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:45.906328 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:45.919555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f0109c0a-a6aa-45ce-8e26-77d2ede75046 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.342900 May 23 20:23:45.921769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 57/123] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:45 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:45.973513 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:45.981615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:45.983846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:45.984974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d0c018ec-523a-4a5e-9bf8-523f29ab9b93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.213737 May 23 20:23:45.985898 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 67/124] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:45 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:46.299076 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-97a1ffbf-cb22-4f28-94bd-98f16aa4b78f req-4570fac1-478e-4574-a059-325f23b48920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f258da-266e-4cb0-8c76-5a3329d1fdc5", "tag": "9991b679-f7be-400d-a65d-c38eece74bbe"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:46.307514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-97a1ffbf-cb22-4f28-94bd-98f16aa4b78f req-4570fac1-478e-4574-a059-325f23b48920 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:46.308658 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-97a1ffbf-cb22-4f28-94bd-98f16aa4b78f req-4570fac1-478e-4574-a059-325f23b48920 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:46.320165 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-97a1ffbf-cb22-4f28-94bd-98f16aa4b78f req-4570fac1-478e-4574-a059-325f23b48920 service nova] Creating event network-changed:9991b679-f7be-400d-a65d-c38eece74bbe for instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 on hv-cinder-84301 May 23 20:23:46.325586 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-97a1ffbf-cb22-4f28-94bd-98f16aa4b78f req-4570fac1-478e-4574-a059-325f23b48920 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030201 May 23 20:23:46.326288 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 58/125] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:46.463684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:46.464688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:46.472355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:46.473152 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:46.474468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:46.477209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:46.670428 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:46.678361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1b089ed0-30f1-4116-9162-536436ca4d16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.219771 May 23 20:23:46.679369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 68/126] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:46 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:46.940300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:46.946085 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:46.950147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:46.950888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:46.951762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:46.952204 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:47.004719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:47.007143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:47.014368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:47.014892 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:47.015920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:47.016789 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:47.141376 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:47.150518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-da07ba4c-1a13-4b99-b089-9317f05904e9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.215965 May 23 20:23:47.151786 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 59/127] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:46 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:47.238280 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:47.246044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:47.247585 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:47.248698 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f7ddae64-2049-4953-ae56-266aa2600870 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.249137 May 23 20:23:47.249234 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 69/128] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:46 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:47.257623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ac7c11f1-bb85-44a6-b381-8e63553605fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7a72aeb-97a6-46ad-a062-e049f4b55777"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:47.258958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ac7c11f1-bb85-44a6-b381-8e63553605fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:47.271974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac7c11f1-bb85-44a6-b381-8e63553605fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:47.271974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac7c11f1-bb85-44a6-b381-8e63553605fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:47.271974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac7c11f1-bb85-44a6-b381-8e63553605fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:47.271974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac7c11f1-bb85-44a6-b381-8e63553605fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:47.704132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:47.704132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:47.706793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:47.707245 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:47.708015 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:47.708638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:47.849360 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:47.857426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-090cb449-c020-49f0-98d9-6fd87210508d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.165781 May 23 20:23:47.858104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 70/129] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:47 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:48.091629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:48.143833 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:48.167759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:48.168546 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:48.174630 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:48.175077 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:48.175831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:48.176391 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:48.320427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:48.328429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c8646c4e-7c81-47a0-b4f5-60eebc050d4f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1368 microversion: 2.1 time: 0.165169 May 23 20:23:48.328987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 71/130] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:48 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:48.335880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:48.336493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:48.343221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:48.343667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:48.344432 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:48.344866 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:48.492235 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:48.501321 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:48.503666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:48.505099 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-33595cbf-3966-4582-a44b-9e2ccfcaddb0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.175169 May 23 20:23:48.505654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 72/131] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:48 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:48.857971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ac7c11f1-bb85-44a6-b381-8e63553605fe tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "POST /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.603905 May 23 20:23:48.864387 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 60/132] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:23:47 2022] POST /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895/os-volume_attachments => generated 194 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:48.875979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:48.877336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:48.883466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:48.896978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:48.899812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:48.903410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:48.904655 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:49.102395 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:49.110704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a32a18d7-3a53-4589-9599-7e2a12837302 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.239397 May 23 20:23:49.111468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 73/133] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:48 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:49.346521 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:49.347313 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:49.359004 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:49.359550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:49.360329 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:49.360774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:49.500964 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:49.510028 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c55dea5a-e259-4fd2-938d-8835b037574a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1559 microversion: 2.1 time: 0.168232 May 23 20:23:49.510593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 61/134] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:49 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:49.527733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:49.527733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:49.533101 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:49.533753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:49.534114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-635afc75-5329-410c-b3cc-c69e9e17437c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:49.534670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-635afc75-5329-410c-b3cc-c69e9e17437c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:49.535041 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:49.535686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:49.543100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-635afc75-5329-410c-b3cc-c69e9e17437c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:49.545774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-635afc75-5329-410c-b3cc-c69e9e17437c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:49.545774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-635afc75-5329-410c-b3cc-c69e9e17437c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:49.545774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-635afc75-5329-410c-b3cc-c69e9e17437c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:49.624056 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-635afc75-5329-410c-b3cc-c69e9e17437c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093833 May 23 20:23:49.624753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 62/135] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:23:49 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:49.894117 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:49.907749 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:49.910943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:49.912626 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-485161f6-5021-4545-b93a-8c1d1615d462 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.393480 May 23 20:23:49.913641 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 74/136] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:49 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:23:50.131600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:50.131600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:50.134819 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:50.135273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:50.136621 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:50.137058 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:50.551638 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:50.572492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-64562d7f-53e9-46ee-a931-66d402be9152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.438044 May 23 20:23:50.572492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 63/137] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:50 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:50.931889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:50.932540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:50.939926 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:50.940504 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:50.941478 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:50.942087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:51.097808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-8203c508-aff8-4d0b-aaed-0f6ab8cacfe9 req-63410e71-5ded-4b04-bca0-315d22c778bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e99c75-f555-4442-9cb8-9b296d90b049", "tag": "b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:51.108349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-8203c508-aff8-4d0b-aaed-0f6ab8cacfe9 req-63410e71-5ded-4b04-bca0-315d22c778bd service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:51.108953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-8203c508-aff8-4d0b-aaed-0f6ab8cacfe9 req-63410e71-5ded-4b04-bca0-315d22c778bd service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:51.223349 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:51.235233 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:51.243300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:51.243300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6c141115-4a09-4f26-8dd6-4b4907c39d28 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.312223 May 23 20:23:51.250917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 75/138] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:50 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:51.284622 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-8203c508-aff8-4d0b-aaed-0f6ab8cacfe9 req-63410e71-5ded-4b04-bca0-315d22c778bd service nova] Creating event network-changed:b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e for instance 81e99c75-f555-4442-9cb8-9b296d90b049 on hv-cinder-84301 May 23 20:23:51.290558 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-8203c508-aff8-4d0b-aaed-0f6ab8cacfe9 req-63410e71-5ded-4b04-bca0-315d22c778bd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196753 May 23 20:23:51.291357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 64/139] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:51.561845 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-7aee7e65-5991-4857-b2da-1fd5cc6808f0 req-0053a046-bcf1-4793-8bf9-74e5b17e1a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881652d5-5df9-43a8-b417-afe21877e7f2", "name": "network-vif-plugged", "status": "completed", "tag": "d0965418-0eb9-41f9-bd9a-a071392128fb"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:51.575739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-7aee7e65-5991-4857-b2da-1fd5cc6808f0 req-0053a046-bcf1-4793-8bf9-74e5b17e1a27 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:51.576189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-7aee7e65-5991-4857-b2da-1fd5cc6808f0 req-0053a046-bcf1-4793-8bf9-74e5b17e1a27 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:51.588377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:51.589909 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:51.601002 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:51.601756 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:51.602899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:51.603290 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-7aee7e65-5991-4857-b2da-1fd5cc6808f0 req-0053a046-bcf1-4793-8bf9-74e5b17e1a27 service nova] Creating event network-vif-plugged:d0965418-0eb9-41f9-bd9a-a071392128fb for instance 881652d5-5df9-43a8-b417-afe21877e7f2 on hv-cinder-84301 May 23 20:23:51.603967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:51.609608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-7aee7e65-5991-4857-b2da-1fd5cc6808f0 req-0053a046-bcf1-4793-8bf9-74e5b17e1a27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053634 May 23 20:23:51.613709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 76/140] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:23:51.921145 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:51.931541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e8d9848d-2fa0-40ac-b9d4-3f0348459594 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.347950 May 23 20:23:51.932357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 65/141] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:51 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:52.257836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:52.258557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:52.266118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:52.266846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:52.267830 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:52.268848 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:52.452715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:52.461036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:52.462848 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:52.464364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ff2d2930-b7a4-4088-975c-67e7b9b4f688 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.210724 May 23 20:23:52.475867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 77/142] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:52 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:52.948663 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:52.949173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:52.955865 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:52.956307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:52.957062 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:52.957543 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:53.090645 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:53.099575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3b15a2d9-19e0-4f0b-ac04-ccd29ba37c3c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.154838 May 23 20:23:53.100142 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 66/143] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:52 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:53.484611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:53.484611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:53.489030 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:53.489466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:53.490252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:53.490677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:53.622589 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:53.624953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:53.626208 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-1f0a8e17-b8f5-4b68-8886-c89d751a4f32 req-d6f5f600-8d90-4a8f-afee-b1986a457075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d11af6-2834-47d4-92cc-ee3135a9f976", "name": "network-vif-plugged", "status": "completed", "tag": "f9e2fedd-ed41-4d66-9fcb-34b45c5b6538"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:53.632539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:53.634152 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:53.634663 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-1f0a8e17-b8f5-4b68-8886-c89d751a4f32 req-d6f5f600-8d90-4a8f-afee-b1986a457075 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:53.635229 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-1f0a8e17-b8f5-4b68-8886-c89d751a4f32 req-d6f5f600-8d90-4a8f-afee-b1986a457075 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:53.636091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8ba342a6-9485-4945-a37b-7ec04b17805f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.157252 May 23 20:23:53.636939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 78/144] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:53 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:53.647187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-1f0a8e17-b8f5-4b68-8886-c89d751a4f32 req-d6f5f600-8d90-4a8f-afee-b1986a457075 service nova] Creating event network-vif-plugged:f9e2fedd-ed41-4d66-9fcb-34b45c5b6538 for instance 27d11af6-2834-47d4-92cc-ee3135a9f976 on hv-cinder-84301 May 23 20:23:53.652694 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-1f0a8e17-b8f5-4b68-8886-c89d751a4f32 req-d6f5f600-8d90-4a8f-afee-b1986a457075 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030215 May 23 20:23:53.653282 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 67/145] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:23:54.117668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:54.118424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:54.125858 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:54.126358 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:54.127116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:54.127557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:54.263694 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:54.272129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4de854ae-1f2a-451c-b56f-e8599e4dfcb2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1321 microversion: 2.1 time: 0.158029 May 23 20:23:54.272129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 79/146] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:54 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:54.655438 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:54.656635 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:54.663452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:54.670575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:54.670575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:54.670575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:54.802271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:54.808015 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:54.809547 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:54.810674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dadfcd8d-d2af-4e09-9a63-97fd5574f8e3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.160134 May 23 20:23:54.811218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 68/147] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:54 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:55.288596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:55.289201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:55.295952 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.296524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:55.299022 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.299450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:55.425601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:55.433143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-554649c8-24d5-4144-a5dd-81ae7c2b07b5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1515 microversion: 2.1 time: 0.148882 May 23 20:23:55.433688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 80/148] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:55 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:55.449803 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:23:55.450768 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:55.457051 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.457493 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:55.458342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.458775 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:55.482147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lazy-loading 'flavor' on Instance uuid 881652d5-5df9-43a8-b417-afe21877e7f2 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:23:55.828797 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:55.829603 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:55.844825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.845272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:55.846076 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.846517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:55.886698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-aff7e828-82c4-45ad-8cb3-24d3866c8ba8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2/action" status: 200 len: 32 microversion: 2.1 time: 0.439923 May 23 20:23:55.887833 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 69/149] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:23:55 2022] POST /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 20:23:55.897488 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:55.898243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:55.905186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.905846 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:55.907838 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:55.907838 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:56.004150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:56.013184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:56.014760 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:56.015871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a7422f7f-0fae-455c-a8aa-abba576516d3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.191129 May 23 20:23:56.016444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 81/150] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:55 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:23:56.049757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:56.058118 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-aefd14b6-3804-4077-903c-2a30a38894e2 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.164578 May 23 20:23:56.058687 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 70/151] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:55 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:57.036235 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:57.036861 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:57.043494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:57.043939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:57.044692 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:57.045123 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:57.075046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:57.075646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:57.078211 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:23:57.083502 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:57.083948 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:57.084711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:57.085427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:57.240609 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:57.252303 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:57.256206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:57.257759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:57.258927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e92ef7dd-acc8-4ee0-a666-3d449d6736af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1407 microversion: 2.20 time: 0.226605 May 23 20:23:57.259178 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6bc8e9d2-f90e-40e1-905b-cc012557e648 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.187819 May 23 20:23:57.259468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 82/152] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:57 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:57.265195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 71/153] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:57 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:23:58.281524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:58.282038 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:58.282396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:58.283830 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:58.290444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:58.291169 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:58.291469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:58.291964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:58.293121 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:58.293472 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:58.294150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:58.294778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:58.435839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:58.438521 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:58.444113 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:58.445619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:58.446006 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f8d2b225-d508-4589-a8cc-84904cd36113 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.169338 May 23 20:23:58.446835 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 72/154] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:58 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:58.447067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-24ff05aa-5c58-4edc-9f04-5680469bdaa3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1599 microversion: 2.20 time: 0.173591 May 23 20:23:58.447446 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 83/155] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:23:58 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:23:58.465949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a473407f-a8a1-4198-9fad-2fbe06e9c44a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:58.465949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a473407f-a8a1-4198-9fad-2fbe06e9c44a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:58.471863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a473407f-a8a1-4198-9fad-2fbe06e9c44a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:58.472306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a473407f-a8a1-4198-9fad-2fbe06e9c44a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:58.473054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a473407f-a8a1-4198-9fad-2fbe06e9c44a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:58.473480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a473407f-a8a1-4198-9fad-2fbe06e9c44a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:58.558888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a473407f-a8a1-4198-9fad-2fbe06e9c44a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.097793 May 23 20:23:58.560346 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 73/156] 10.222.0.16 () {60 vars in 1315 bytes} [Mon May 23 20:23:58 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:23:59.134198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:59.135491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:59.149405 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:59.149989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:59.156530 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:59.157066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:59.188258 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:23:59.465338 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:59.466056 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:59.472358 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:59.472888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:59.473739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:59.474284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:59.556486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-980fde93-ef83-481d-b3f5-48b4866f5552 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 204 len: 0 microversion: 2.1 time: 0.433558 May 23 20:23:59.559019 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 84/157] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:23:59 2022] DELETE /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:23:59.570106 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:23:59.571597 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:23:59.581194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:59.581988 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:59.583149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:23:59.584240 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:23:59.800753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:59.830660 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-71c0f0a0-a9fb-4842-a73f-b4d16f218d33 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1554 microversion: 2.1 time: 0.266583 May 23 20:23:59.839341 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:23:59.840627 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 85/158] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:59 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1554 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:23:59.852029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-de3c129a-e762-4b43-b505-26e7bc934a00 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.391250 May 23 20:23:59.858475 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 74/159] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:23:59 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:00.423741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-1a76f28d-f363-477f-9eb8-a489310a2632 req-2f483693-340c-4e2c-9794-7df8e8e797f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d11af6-2834-47d4-92cc-ee3135a9f976", "tag": "f9e2fedd-ed41-4d66-9fcb-34b45c5b6538"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:00.423741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-1a76f28d-f363-477f-9eb8-a489310a2632 req-2f483693-340c-4e2c-9794-7df8e8e797f6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:00.423741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-1a76f28d-f363-477f-9eb8-a489310a2632 req-2f483693-340c-4e2c-9794-7df8e8e797f6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:00.423741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-1a76f28d-f363-477f-9eb8-a489310a2632 req-2f483693-340c-4e2c-9794-7df8e8e797f6 service nova] Creating event network-changed:f9e2fedd-ed41-4d66-9fcb-34b45c5b6538 for instance 27d11af6-2834-47d4-92cc-ee3135a9f976 on hv-cinder-84301 May 23 20:24:00.425460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-1a76f28d-f363-477f-9eb8-a489310a2632 req-2f483693-340c-4e2c-9794-7df8e8e797f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028869 May 23 20:24:00.425460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 86/160] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:24:00.847454 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:00.848499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:00.855484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:00.855926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:00.856680 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:00.857107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:00.873916 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:00.877487 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:00.885172 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:00.885888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:00.893512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:00.893512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:01.064184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:01.068509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:01.076788 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-574dd8a3-7561-4d5a-8098-f84ee37814ca tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.211523 May 23 20:24:01.087348 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 87/161] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:00 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:24:01.102780 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7dece719-8969-4716-98ea-db6e712f7a38 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1554 microversion: 2.1 time: 0.259658 May 23 20:24:01.106209 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 75/162] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:00 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1554 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:02.100002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:02.102132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:02.115583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:02.121602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:02.126461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:02.126697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:02.127364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:02.127463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:02.132347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:02.132833 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:02.140454 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:02.140914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:02.445147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:02.447404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:02.456189 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-08169afd-7100-46df-93ca-83d2eb62abd6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1554 microversion: 2.1 time: 0.336210 May 23 20:24:02.457123 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 76/163] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:02 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:02.472499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-656e1305-9796-42e2-84f4-afaeb989b644 req-f25a542a-bbd9-407e-8354-53ee44ed931a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ecf2ba5-daf8-4535-9e28-5ee169593895", "name": "network-vif-deleted", "tag": "cd556b35-e6cf-468e-aa39-ceba38437792"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:02.481315 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-656e1305-9796-42e2-84f4-afaeb989b644 req-f25a542a-bbd9-407e-8354-53ee44ed931a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:02.482003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-656e1305-9796-42e2-84f4-afaeb989b644 req-f25a542a-bbd9-407e-8354-53ee44ed931a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:02.490459 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:02.501770 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-066f656c-6926-4dfe-9a85-4a940257a05d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.410311 May 23 20:24:02.514033 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 88/164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:02 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:02.530362 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-656e1305-9796-42e2-84f4-afaeb989b644 req-f25a542a-bbd9-407e-8354-53ee44ed931a service nova] Creating event network-vif-deleted:cd556b35-e6cf-468e-aa39-ceba38437792 for instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 on hv-cinder-84301 May 23 20:24:02.543642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-656e1305-9796-42e2-84f4-afaeb989b644 req-f25a542a-bbd9-407e-8354-53ee44ed931a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070499 May 23 20:24:02.547662 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 77/165] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:03.475686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:03.481614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:03.482640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:03.483146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:03.483944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:03.484378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:03.521735 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:03.522903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:03.523355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:03.523817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lazy-loading 'fault' on Instance uuid 6ecf2ba5-daf8-4535-9e28-5ee169593895 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:24:03.529284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:03.539374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:03.539828 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:03.540612 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:03.541050 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:03.578169 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:03.588066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-eff97a2b-054e-466b-8e0e-f893af596c96 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1351 microversion: 2.1 time: 0.116223 May 23 20:24:03.598568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 89/166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:03 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:03.715367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:03.725126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-213edd6e-9f0e-47f9-8cb9-158cbdb1f6b1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.207983 May 23 20:24:03.725701 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 78/167] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:03 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:24:04.604502 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:04.605171 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:04.611700 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:04.612143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:04.612894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:04.613326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:04.646513 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:04.646956 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:04.647423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lazy-loading 'fault' on Instance uuid 6ecf2ba5-daf8-4535-9e28-5ee169593895 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:24:04.721375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a58140ac84841dca6ca68a4895abc8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4adfd8b4c74448bd28b8d0bf149c0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:04.735787 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f7601745-57c3-4534-a1f0-198e3e0e264e tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 200 len: 1305 microversion: 2.1 time: 0.135002 May 23 20:24:04.742288 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:04.742884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:04.751030 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 90/168] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:04 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 1305 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:04.753571 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:04.754291 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:04.755063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:04.755876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:04.915548 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:04.923983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-afd223bd-241d-4ea1-850e-5f3fd53e4a55 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.185792 May 23 20:24:04.930940 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 79/169] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:04 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:05.753634 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:05.754358 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:05.760500 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:05.760886 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:05.761579 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:05.762211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:05.775206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] HTTP exception thrown: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Request method failure captured: May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 HTTP/1.1 May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0keYU8D4SN_PiVakshRgQR1ggb81A5L4_KnFQolUqOmQshezWPdUa2LTRoqfwhSkzeJkbHcTtxIWskdKnJrdjU52-18Sp98TuPedafqa4DB5Lq1ZjfcmoowEkZcKUqUEgss65idcw-3gYBlyJyQhnK7JbK7MyZIuU9yljm4ECDUtI May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:05.780241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c4adfd8b4c74448bd28b8d0bf149c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}] May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 9a58140ac84841dca6ca68a4895abc8a May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:05.781933 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '6ecf2ba5-daf8-4535-9e28-5ee169593895'} May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:05.782728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:05.784070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:05.785232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Returning 404 to user: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:05.785232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-519aae32-0df0-4aa8-9ec6-49de23a7fbe4 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 404 len: 111 microversion: 2.1 time: 0.031932 May 23 20:24:05.785232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 91/170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:05 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:24:05.941613 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:05.942241 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:05.949231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:05.949672 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:05.950496 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:05.950951 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:06.100331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:06.101069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-eac32e2f-a13e-4570-b94c-30583e982acc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.163061 May 23 20:24:06.101709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 80/171] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:05 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:06.191877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:06.193086 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:06.199342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:06.199781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:06.200526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:06.200953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:06.214377 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] HTTP exception thrown: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Request method failure captured: May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895/os-volume_attachments HTTP/1.1 May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0keYU8D4SN_PiVakshRgQR1ggb81A5L4_KnFQolUqOmQshezWPdUa2LTRoqfwhSkzeJkbHcTtxIWskdKnJrdjU52-18Sp98TuPedafqa4DB5Lq1ZjfcmoowEkZcKUqUEgss65idcw-3gYBlyJyQhnK7JbK7MyZIuU9yljm4ECDUtI May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:06.216484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c4adfd8b4c74448bd28b8d0bf149c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}] May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 9a58140ac84841dca6ca68a4895abc8a May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:06.218061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'server_id': '6ecf2ba5-daf8-4535-9e28-5ee169593895'} May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:06.221543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:06.222875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:06.224527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Returning 404 to user: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:06.224527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0be9a21d-9469-4168-86b2-7ea71bfc1068 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029976 May 23 20:24:06.224527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 92/172] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:24:06 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:24:07.119276 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:07.120019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:07.127022 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:07.129650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:07.129650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:07.129650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:07.289460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:07.297239 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6826f8fa-6787-4bd8-875d-3e4f1832f41b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.182431 May 23 20:24:07.302068 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 81/173] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:07 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:07.616651 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:07.617265 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:07.624157 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:07.624600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:07.625355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:07.625785 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:07.641358 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] HTTP exception thrown: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Request method failure captured: May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 HTTP/1.1 May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0keYU8D4SN_PiVakshRgQR1ggb81A5L4_KnFQolUqOmQshezWPdUa2LTRoqfwhSkzeJkbHcTtxIWskdKnJrdjU52-18Sp98TuPedafqa4DB5Lq1ZjfcmoowEkZcKUqUEgss65idcw-3gYBlyJyQhnK7JbK7MyZIuU9yljm4ECDUtI May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:07.646507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c4adfd8b4c74448bd28b8d0bf149c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}] May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 9a58140ac84841dca6ca68a4895abc8a May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.647958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '6ecf2ba5-daf8-4535-9e28-5ee169593895'} May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:07.648601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.649642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:07.650776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Returning 404 to user: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:07.650776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1f8496ee-5ba0-4050-a161-2bafafea7ac6 tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 404 len: 111 microversion: 2.1 time: 0.031939 May 23 20:24:07.650776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 93/174] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:24:07 2022] DELETE /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:24:07.656303 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:07.656903 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] [instance: 6ecf2ba5-daf8-4535-9e28-5ee169593895] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:07.663064 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:07.663504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:07.664252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:07.664681 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:07.678879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] HTTP exception thrown: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Request method failure captured: May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 HTTP/1.1 May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-0keYU8D4SN_PiVakshRgQR1ggb81A5L4_KnFQolUqOmQshezWPdUa2LTRoqfwhSkzeJkbHcTtxIWskdKnJrdjU52-18Sp98TuPedafqa4DB5Lq1ZjfcmoowEkZcKUqUEgss65idcw-3gYBlyJyQhnK7JbK7MyZIuU9yljm4ECDUtI May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:24:07.684430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3c4adfd8b4c74448bd28b8d0bf149c0a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3c4adfd8b4c74448bd28b8d0bf149c0a"}]}] May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 3c4adfd8b4c74448bd28b8d0bf149c0a May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-DeleteServersTestJSON-1313114457 May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 9a58140ac84841dca6ca68a4895abc8a May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-DeleteServersTestJSON-1313114457-project May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.685710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '6ecf2ba5-daf8-4535-9e28-5ee169593895'} May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:07.686764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. May 23 20:24:07.687855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:07.688866 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] Returning 404 to user: Instance 6ecf2ba5-daf8-4535-9e28-5ee169593895 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:07.688866 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d703022d-dbfc-4c95-8198-cf248faae73a tempest-DeleteServersTestJSON-1313114457 tempest-DeleteServersTestJSON-1313114457-project] 10.222.0.16 "GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895" status: 404 len: 111 microversion: 2.1 time: 0.033300 May 23 20:24:07.688866 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 82/175] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:07 2022] GET /compute/v2.1/servers/6ecf2ba5-daf8-4535-9e28-5ee169593895 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:24:08.315092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:08.316304 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:08.324320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:08.328582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:08.328582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:08.328582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:08.493410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:08.502469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-be848a2f-0d4b-41d2-a82d-f3946fdbb880 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.191841 May 23 20:24:08.510802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 94/176] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:08 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:09.519293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:09.520746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:09.537242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:09.537693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:09.538528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:09.539149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:09.691166 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:09.702693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-42c2a641-5279-474d-a082-dae1d5f54022 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.185135 May 23 20:24:09.715053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 83/177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:09 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:10.629600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9617fc56-74b5-4388-bb9e-b10051f83f89 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Action: 'create', calling method: .version_select at 0x7f996cf5fdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-383838017", "metadata": {"Type": "work"}}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:10.721907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:10.722697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:10.729187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:10.729625 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:10.731028 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:10.731028 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:10.869934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:10.880076 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-510f242e-fdca-4804-9a52-1fe2a7727e35 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.162138 May 23 20:24:10.880633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 84/178] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:10 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:24:11.452361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9617fc56-74b5-4388-bb9e-b10051f83f89 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.951747 May 23 20:24:11.453066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 95/179] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 20:24:10 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 953 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 23 20:24:11.464858 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e660b4f0-7e19-4adf-bb1c-497e2670b951 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Calling method '.version_select at 0x7f996e1b5f70>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:11.524321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e660b4f0-7e19-4adf-bb1c-497e2670b951 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec" status: 200 len: 352 microversion: 2.1 time: 0.063859 May 23 20:24:11.525365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 85/180] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:24:11 2022] GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:11.897688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:11.898334 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:11.906741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:11.906741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:11.906741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:11.906741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:12.038825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:12.041204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:12.047238 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2842d9ef-2beb-4545-8a14-c705e2858051 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.154172 May 23 20:24:12.047795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 96/181] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:11 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:12.539146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9d2ed2ac-ef76-43d4-9455-4edfdf01055d tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Calling method '.version_select at 0x7f996d8961f0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:12.585654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9d2ed2ac-ef76-43d4-9455-4edfdf01055d tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec" status: 200 len: 353 microversion: 2.1 time: 0.051056 May 23 20:24:12.586529 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 86/182] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:24:12 2022] GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:12.598978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-80f9ef24-a7d1-44e1-afcf-c416f4f9667f tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Calling method '.version_select at 0x7f996cf5fd30>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:12.645794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-80f9ef24-a7d1-44e1-afcf-c416f4f9667f tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec" status: 200 len: 353 microversion: 2.1 time: 0.050725 May 23 20:24:12.646418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 97/183] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:24:12 2022] GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:12.658078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fa5dd34d-0748-47bb-ae60-f2053c56c796 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Calling method '.version_select at 0x7f996d896310>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:12.931956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fa5dd34d-0748-47bb-ae60-f2053c56c796 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec" status: 202 len: 0 microversion: 2.1 time: 0.277597 May 23 20:24:12.932549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 87/184] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:24:12 2022] DELETE /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:24:12.942519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c2cf9560-3a89-4b86-81fa-2f58270d94c3 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Calling method '.version_select at 0x7f996cf5f160>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:13.015945 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c2cf9560-3a89-4b86-81fa-2f58270d94c3 tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec" status: 200 len: 352 microversion: 2.1 time: 0.077326 May 23 20:24:13.016646 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 98/185] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:24:12 2022] GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:13.064982 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:13.065686 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:13.072151 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:13.072603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:13.073574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:13.074049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:13.209020 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:13.216771 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a479f6e7-7f5c-4517-b761-944d9c74bbda tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.155700 May 23 20:24:13.217349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 88/186] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:13 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:24:14.028239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e50b1573-0f49-4296-b0ce-fff45b43f34e tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Calling method '.version_select at 0x7f996cf50ca0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-e50b1573-0f49-4296-b0ce-fff45b43f34e tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] HTTP exception thrown: Volume 74389d33-3fbc-47c6-8dce-13154acb33ec could not be found. May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e50b1573-0f49-4296-b0ce-fff45b43f34e tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Request method failure captured: May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec HTTP/1.1 May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-1q5Bdx8Fc8K7i-3dPKXx-hbVfzms6AhDBKJKjsnxYqp_oeuZpqK2yvCRkNm6LaVzoKARJv54LOas1C60pYFrPf8FpTtBzh7iHXnkspnD2nxvrnv5EE_-BenA8OF8m-nNrmTnLm11-_sluFomvxz4GhmgtRBvrsf_0jkOiCiRT72N8 May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 2cd90d1b84fa42109cb262e63831674e May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesGetTestJSON-170497530 May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:14.058055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2cd90d1b84fa42109cb262e63831674e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cd90d1b84fa42109cb262e63831674e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2cd90d1b84fa42109cb262e63831674e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2cd90d1b84fa42109cb262e63831674e"}]}] May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesGetTestJSON-170497530 May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 2cd90d1b84fa42109cb262e63831674e May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesGetTestJSON-170497530 May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesGetTestJSON-170497530-project May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 8e85517a7cae4996a8a4033a8bfa9136 May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesGetTestJSON-170497530-project May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Volume 74389d33-3fbc-47c6-8dce-13154acb33ec could not be found. May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '74389d33-3fbc-47c6-8dce-13154acb33ec'} May 23 20:24:14.060081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74389d33-3fbc-47c6-8dce-13154acb33ec could not be found. (HTTP 404) (Request-ID: req-d4c8567a-d3be-4b44-b671-e46c94136d58) May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:14.060807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:24:14.061923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74389d33-3fbc-47c6-8dce-13154acb33ec could not be found. May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 20:24:14.063521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74389d33-3fbc-47c6-8dce-13154acb33ec could not be found. May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74389d33-3fbc-47c6-8dce-13154acb33ec could not be found. May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e50b1573-0f49-4296-b0ce-fff45b43f34e tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] Returning 404 to user: Volume 74389d33-3fbc-47c6-8dce-13154acb33ec could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e50b1573-0f49-4296-b0ce-fff45b43f34e tempest-VolumesGetTestJSON-170497530 tempest-VolumesGetTestJSON-170497530-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec" status: 404 len: 109 microversion: 2.1 time: 0.034191 May 23 20:24:14.064792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 99/187] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:24:14 2022] GET /compute/v2.1/os-volumes/74389d33-3fbc-47c6-8dce-13154acb33ec => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:24:14.234242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:14.234854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:14.240872 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:14.241385 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:14.242272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:14.242710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:14.384378 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:14.392898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0e53868e-2d25-4594-90f4-0ffda266823b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.163043 May 23 20:24:14.393481 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 89/188] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:14 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:15.414004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:15.414004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:15.420202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:15.420656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:15.421441 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:15.422530 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:15.589310 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:15.596837 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8b43fe15-f73e-434b-b03f-0e8cc34bf04f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.190777 May 23 20:24:15.597391 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 100/189] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:15 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:16.593746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-337e8210-99ed-4abc-a63d-9399aca03993 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Action: 'create', calling method: .version_select at 0x7f996d7604c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1561508458", "metadata": {"Type": "work"}}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-337e8210-99ed-4abc-a63d-9399aca03993 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Request method failure captured: May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 122 May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-1wiBss-JifR5QR_UEfg9P9wuHJ3qVFCNjE_oV6Egor_GR-LYXfqxK7VU5zpvTi10n4HrsFSE5ljcILxEfSa1gRsWj1w5jf8liVDT2Gsah6oqXXvMJe_8y4_GB3l2BoxKZssGzdfvcgB5caJ_w-7nMdxXXuLxtLIHHWn1AK4ti63is May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:24:16.601048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd6b2fe6f2c34d4e94428ad80b2595bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}] May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: ee992f702dff4a57a060c799c6450617 May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1561508458", "metadata": {"Type": "work"}}} May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: May 23 20:24:16.602565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1561508458', 'metadata': {'Type': 'work'}}}} May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise error May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi '#$%' May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:16.603460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 20:24:16.604876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 20:24:16.606899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 23 20:24:16.606899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:24:16.606899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-337e8210-99ed-4abc-a63d-9399aca03993 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:16.606899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-337e8210-99ed-4abc-a63d-9399aca03993 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.185740 May 23 20:24:16.606899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 90/190] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 20:24:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 20:24:16.613217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5235b0c6-76d4-438f-b834-c28b7551ed3c tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Action: 'create', calling method: .version_select at 0x7f996cf50c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1711888731", "metadata": {"Type": "work"}}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5235b0c6-76d4-438f-b834-c28b7551ed3c tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Request method failure captured: May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 120 May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-1wiBss-JifR5QR_UEfg9P9wuHJ3qVFCNjE_oV6Egor_GR-LYXfqxK7VU5zpvTi10n4HrsFSE5ljcILxEfSa1gRsWj1w5jf8liVDT2Gsah6oqXXvMJe_8y4_GB3l2BoxKZssGzdfvcgB5caJ_w-7nMdxXXuLxtLIHHWn1AK4ti63is May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:16.616497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd6b2fe6f2c34d4e94428ad80b2595bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}] May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: ee992f702dff4a57a060c799c6450617 May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1711888731", "metadata": {"Type": "work"}}} May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:24:16.617673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1711888731', 'metadata': {'Type': 'work'}}}} May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise error May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi '0' May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:16.618644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 20:24:16.619795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 20:24:16.620976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 23 20:24:16.620976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.620976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5235b0c6-76d4-438f-b834-c28b7551ed3c tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:16.620976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5235b0c6-76d4-438f-b834-c28b7551ed3c tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010357 May 23 20:24:16.627583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 101/191] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 20:24:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 20:24:16.632202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cc98a9ee-22ad-422d-a764-0a780bdad78e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Action: 'create', calling method: .version_select at 0x7f996cef6160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1907360425", "metadata": {"Type": "work"}}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cc98a9ee-22ad-422d-a764-0a780bdad78e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Request method failure captured: May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 119 May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-1wiBss-JifR5QR_UEfg9P9wuHJ3qVFCNjE_oV6Egor_GR-LYXfqxK7VU5zpvTi10n4HrsFSE5ljcILxEfSa1gRsWj1w5jf8liVDT2Gsah6oqXXvMJe_8y4_GB3l2BoxKZssGzdfvcgB5caJ_w-7nMdxXXuLxtLIHHWn1AK4ti63is May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:16.634508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd6b2fe6f2c34d4e94428ad80b2595bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}] May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: ee992f702dff4a57a060c799c6450617 May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1907360425", "metadata": {"Type": "work"}}} May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:24:16.636036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1907360425', 'metadata': {'Type': 'work'}}}} May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise error May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi On instance['volume']: May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi '' May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:16.637486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 23 20:24:16.640246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 23 20:24:16.642309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 23 20:24:16.642309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.642562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:16.642562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:16.642842 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cc98a9ee-22ad-422d-a764-0a780bdad78e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:16.642842 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cc98a9ee-22ad-422d-a764-0a780bdad78e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013811 May 23 20:24:16.642842 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 102/192] 10.222.0.16 () {60 vars in 1155 bytes} [Mon May 23 20:24:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 20:24:16.657029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:16.657603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:16.658817 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:16.659255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:16.664910 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-55b01ac3-ad53-46a0-b5c6-c4bd79ef58e0 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Calling method '.version_select at 0x7f996cf50790>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:16.695987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-55b01ac3-ad53-46a0-b5c6-c4bd79ef58e0 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] HTTP exception thrown: Volume tempest-invalid-34335571 could not be found. May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-55b01ac3-ad53-46a0-b5c6-c4bd79ef58e0 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Request method failure captured: May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-34335571 HTTP/1.1 May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-1wiBss-JifR5QR_UEfg9P9wuHJ3qVFCNjE_oV6Egor_GR-LYXfqxK7VU5zpvTi10n4HrsFSE5ljcILxEfSa1gRsWj1w5jf8liVDT2Gsah6oqXXvMJe_8y4_GB3l2BoxKZssGzdfvcgB5caJ_w-7nMdxXXuLxtLIHHWn1AK4ti63is May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:16.697968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd6b2fe6f2c34d4e94428ad80b2595bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}] May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: ee992f702dff4a57a060c799c6450617 May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Volume tempest-invalid-34335571 could not be found. May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'tempest-invalid-34335571'} May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:16.707417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-34335571 could not be found. (HTTP 404) (Request-ID: req-d3c58ce9-f74e-4a6d-b6ea-533aef4e7d53) May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.708685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 20:24:16.711501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-34335571 could not be found. May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:16.713014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-34335571 could not be found. May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-34335571 could not be found. May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-55b01ac3-ad53-46a0-b5c6-c4bd79ef58e0 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Returning 404 to user: Volume tempest-invalid-34335571 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-55b01ac3-ad53-46a0-b5c6-c4bd79ef58e0 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-34335571" status: 404 len: 97 microversion: 2.1 time: 0.048759 May 23 20:24:16.716223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 103/193] 10.222.0.16 () {58 vars in 1211 bytes} [Mon May 23 20:24:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-34335571 => generated 97 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 23 20:24:16.721206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3e4a2a79-7432-4b41-ab33-4991d1696919 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005166 May 23 20:24:16.721784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 104/194] 10.222.0.16 () {58 vars in 1139 bytes} [Mon May 23 20:24:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 23 20:24:16.730460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1f415915-85f5-4012-8af1-f8c04cc2f25c tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003772 May 23 20:24:16.730962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 105/195] 10.222.0.16 () {58 vars in 1136 bytes} [Mon May 23 20:24:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 23 20:24:16.740203 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-304e8982-6526-4c33-bab5-1f5200378d08 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Calling method '.version_select at 0x7f996cf5fee0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:16.771466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-304e8982-6526-4c33-bab5-1f5200378d08 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] HTTP exception thrown: Volume 5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c could not be found. May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-304e8982-6526-4c33-bab5-1f5200378d08 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Request method failure captured: May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/os-volumes/5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c HTTP/1.1 May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-1wiBss-JifR5QR_UEfg9P9wuHJ3qVFCNjE_oV6Egor_GR-LYXfqxK7VU5zpvTi10n4HrsFSE5ljcILxEfSa1gRsWj1w5jf8liVDT2Gsah6oqXXvMJe_8y4_GB3l2BoxKZssGzdfvcgB5caJ_w-7nMdxXXuLxtLIHHWn1AK4ti63is May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:16.773422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd6b2fe6f2c34d4e94428ad80b2595bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}] May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: ee992f702dff4a57a060c799c6450617 May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Volume 5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c could not be found. May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c'} May 23 20:24:16.774974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c could not be found. (HTTP 404) (Request-ID: req-f37332e5-7f07-4783-a0f6-a78844be6682) May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.775781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 23 20:24:16.776829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c could not be found. May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 23 20:24:16.779632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c could not be found. May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c could not be found. May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-304e8982-6526-4c33-bab5-1f5200378d08 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Returning 404 to user: Volume 5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-304e8982-6526-4c33-bab5-1f5200378d08 tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c" status: 404 len: 109 microversion: 2.1 time: 0.038593 May 23 20:24:16.781105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 106/196] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:24:16 2022] DELETE /compute/v2.1/os-volumes/5ee5ebb9-1d00-4fcb-91e5-1d27d4cd573c => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 20:24:16.788025 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-738f9639-bad7-495f-87ad-1b33637b373e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Calling method '.version_select at 0x7f996cf503a0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:16.819635 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-738f9639-bad7-495f-87ad-1b33637b373e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] HTTP exception thrown: Volume 04deab29-c7c5-4721-bad9-3aafdbb04a45 could not be found. May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-738f9639-bad7-495f-87ad-1b33637b373e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Request method failure captured: May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/os-volumes/04deab29-c7c5-4721-bad9-3aafdbb04a45 HTTP/1.1 May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-1wiBss-JifR5QR_UEfg9P9wuHJ3qVFCNjE_oV6Egor_GR-LYXfqxK7VU5zpvTi10n4HrsFSE5ljcILxEfSa1gRsWj1w5jf8liVDT2Gsah6oqXXvMJe_8y4_GB3l2BoxKZssGzdfvcgB5caJ_w-7nMdxXXuLxtLIHHWn1AK4ti63is May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:24:16.821545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dd6b2fe6f2c34d4e94428ad80b2595bd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dd6b2fe6f2c34d4e94428ad80b2595bd"}]}] May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: dd6b2fe6f2c34d4e94428ad80b2595bd May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesNegativeTest-956447669 May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: ee992f702dff4a57a060c799c6450617 May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesNegativeTest-956447669-project May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Volume 04deab29-c7c5-4721-bad9-3aafdbb04a45 could not be found. May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '04deab29-c7c5-4721-bad9-3aafdbb04a45'} May 23 20:24:16.822811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 04deab29-c7c5-4721-bad9-3aafdbb04a45 could not be found. (HTTP 404) (Request-ID: req-506558f1-f678-4ab8-ac55-ab82fb41490b) May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.823640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi item = cinderclient( May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 23 20:24:16.825156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 04deab29-c7c5-4721-bad9-3aafdbb04a45 could not be found. May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 23 20:24:16.826223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 04deab29-c7c5-4721-bad9-3aafdbb04a45 could not be found. May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 04deab29-c7c5-4721-bad9-3aafdbb04a45 could not be found. May 23 20:24:16.827201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:24:16.828641 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-738f9639-bad7-495f-87ad-1b33637b373e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] Returning 404 to user: Volume 04deab29-c7c5-4721-bad9-3aafdbb04a45 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:24:16.829887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-738f9639-bad7-495f-87ad-1b33637b373e tempest-VolumesNegativeTest-956447669 tempest-VolumesNegativeTest-956447669-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/04deab29-c7c5-4721-bad9-3aafdbb04a45" status: 404 len: 109 microversion: 2.1 time: 0.046114 May 23 20:24:16.830448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 107/197] 10.222.0.16 () {58 vars in 1244 bytes} [Mon May 23 20:24:16 2022] GET /compute/v2.1/os-volumes/04deab29-c7c5-4721-bad9-3aafdbb04a45 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:24:16.838122 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:16.840090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-958a993a-c12b-47e2-b177-6b3da6dabade tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.220669 May 23 20:24:16.840895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 91/198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:16 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:17.859356 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:17.859959 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:17.866764 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:17.867144 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:17.867890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:17.868319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:18.026041 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:18.036154 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4670eba1-c2b5-4e13-8f9b-06d02373a97f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.180344 May 23 20:24:18.036721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 108/199] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:17 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:19.063188 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:19.066488 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:19.107665 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:19.112019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:19.114380 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:19.115695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:19.747253 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:19.756373 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dda8f077-919d-4868-b16d-9043e8f6f0a1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.706731 May 23 20:24:19.767060 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 92/200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:19 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:20.772759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:20.773446 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:20.780308 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:20.780899 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:20.781599 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:20.786145 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:20.933758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:20.942223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9204ed16-1a43-4b83-b66b-14c7392fb4de tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.173283 May 23 20:24:20.952836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 109/201] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:20 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:21.960308 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:21.961000 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:21.968587 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:21.969080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:21.969834 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:21.970306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:22.113351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:22.121717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e9652ae9-32ef-4103-974a-02589bd8bde1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.165171 May 23 20:24:22.128962 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 93/202] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:21 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:23.138838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:23.140024 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:23.148416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:23.149905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:23.150458 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:23.151237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:23.152798 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:23.414685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:23.423237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-792d5687-cd66-4e1f-a244-a1b11406236e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.288126 May 23 20:24:23.424468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 110/203] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:23 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:24.445591 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:24.446372 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:24.453077 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:24.453573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:24.454717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:24.455155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:24.597662 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:24.606182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7774fb3f-6933-4155-bfbf-561307ff5a5a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.169206 May 23 20:24:24.614549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 94/204] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:24 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:25.624099 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:25.625116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:25.632009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:25.632523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:25.633335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:25.635597 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:26.044067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:26.051944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-21aae80f-e386-4259-a1cd-976c0062ae8f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.432384 May 23 20:24:26.052519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 111/205] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:25 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:27.075724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:27.075724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:27.085855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:27.086311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:27.087751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:27.088439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:27.321532 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:27.331648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d59ca97f-47e7-4856-a925-62330f0e2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.265350 May 23 20:24:27.332231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 95/206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:27 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:28.347961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:28.352060 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:28.358958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:28.359720 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:28.360729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:28.362202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:28.638415 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:28.646998 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0939abf1-e023-4b1a-a039-21e55cc6d4c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.302884 May 23 20:24:28.650769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 112/207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:28 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:29.664475 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:29.665854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:29.676864 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=42 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:29.678444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:29.679987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:29.680923 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:29.707012 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:30.341420 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:30.350939 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a82573d6-53b0-4701-87aa-30ede5861152 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.691344 May 23 20:24:30.351621 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 96/208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:29 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:30.686575 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7b74ffb9-4780-4af0-af96-52385db5c3bb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Action: 'create', calling method: .version_select at 0x7f996cf5f8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-990032347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFFIYT7g+1nGGWgWMAMgZYkURtr2bFiD1uWp3c3jI2t7A/eTJqeCfs0Za1YFDPY+efuDqM15c/kMuMzSmGDlBmXsLzjOCZIWKlgcFrtQFaUsW67vNqAwf6gIp3rt8WhWA=="}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:30.701547 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-7b74ffb9-4780-4af0-af96-52385db5c3bb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Getting quotas for project d8f120eaf89b4ef29fc92cf544ff1000. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:24:30.705643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-7b74ffb9-4780-4af0-af96-52385db5c3bb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Getting quotas for user 3be98a16abca4b5ea9e54a29f9b4ea62 and project d8f120eaf89b4ef29fc92cf544ff1000. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:24:30.791891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7b74ffb9-4780-4af0-af96-52385db5c3bb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.296710 May 23 20:24:30.792529 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 113/209] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:24:30 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:31.367890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:31.368498 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:31.375381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:31.375845 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:31.376595 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:31.377023 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:31.518084 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:31.526126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bff61a65-b180-4e3e-a83f-f80f35655df3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.162164 May 23 20:24:31.527718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 97/210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:31 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:32.544568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:32.546292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:32.552794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:32.553539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:32.554440 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:32.555152 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:32.783407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:32.791964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-230188cd-14f0-4862-bae3-21e57e194312 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.252116 May 23 20:24:32.793473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 114/211] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:32 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:33.810075 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:33.810899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:33.818635 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:33.819160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:33.820019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:33.820533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:34.044523 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:34.052246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:34.060683 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5684dd24-c8ce-43c5-8a08-0f65a9844d51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.254999 May 23 20:24:34.061293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 98/212] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:33 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:35.077575 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:35.078257 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:35.084960 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:35.085401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:35.086213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:35.086642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:35.223725 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:35.231539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-73d26ac8-b731-4e14-a9d5-945c970e1389 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.158640 May 23 20:24:35.232102 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 115/213] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:35 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:24:36.252776 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:36.253388 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:36.260417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:36.261373 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:36.262298 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:36.262848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:36.409125 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:36.417058 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2b06c602-e1cc-4d41-9a67-b1108fec85df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.168212 May 23 20:24:36.417624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 99/214] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:36 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:37.434654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:37.435272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:37.441782 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:37.442253 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:37.443007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:37.443431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:37.591506 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:37.600303 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3e52b2dc-9a4e-4a9b-8fad-b1cd40ac65e3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.169786 May 23 20:24:37.601071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 116/215] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:37 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:38.616986 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:38.617453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:38.625065 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:38.625513 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:38.626507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:38.627114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:38.783975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:38.791941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f9b9509d-acdd-4818-b75b-0d84158f4ec3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.178898 May 23 20:24:38.792587 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 100/216] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:38 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:39.809962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:39.810598 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:39.816975 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:39.817426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:39.818215 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:39.823045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:39.953000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:39.963863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7753efd1-c503-40ce-b231-bf68d6a3f0cc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.158484 May 23 20:24:39.964740 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 117/217] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:39 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:40.980910 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:40.982086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:40.988358 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:40.988805 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:40.990880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:40.990880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:41.193186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:41.205636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-63c74dd7-b7a9-4e6a-a29c-1a6cbe778793 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.228523 May 23 20:24:41.206408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 101/218] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:40 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:41.918696 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b8c7a395-a501-46b7-9828-de8a74a32fe4 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:41.919233 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b8c7a395-a501-46b7-9828-de8a74a32fe4 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:41.921023 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=4 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:41.925779 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b8c7a395-a501-46b7-9828-de8a74a32fe4 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:41.926281 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b8c7a395-a501-46b7-9828-de8a74a32fe4 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:41.927025 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b8c7a395-a501-46b7-9828-de8a74a32fe4 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:41.927449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b8c7a395-a501-46b7-9828-de8a74a32fe4 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:41.950254 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b8c7a395-a501-46b7-9828-de8a74a32fe4 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/ips" status: 200 len: 145 microversion: 2.1 time: 0.035970 May 23 20:24:41.950810 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 118/219] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:24:41 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:24:42.232218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:42.233055 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:42.240856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:42.242136 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:42.244096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:42.244870 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:42.427160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:42.436943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7f35b699-8ac3-4812-be1b-44c580fcf88e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1521 microversion: 2.1 time: 0.217625 May 23 20:24:42.438338 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 102/220] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:42 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:43.455209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:43.456102 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:43.471218 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:43.471846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:43.482116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:43.482737 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:43.708792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:43.717790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d415ca66-b152-4a9a-bc96-b1d098edf8ff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1501 microversion: 2.1 time: 0.266813 May 23 20:24:43.719260 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 119/221] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:43 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1501 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:43.738767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:43.739664 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:43.747232 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:43.747688 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:43.748488 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:43.748924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:43.921321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:43.930049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3acf4163-e824-4619-ab21-5ed0739fae5e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1515 microversion: 2.1 time: 0.197401 May 23 20:24:43.943278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 103/222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:43 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1515 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:45.586385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1983f344-3b7a-4638-a457-105cfe00eb4f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24976fb0-f43b-4481-b112-975e5c71d5ff"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:45.588868 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1983f344-3b7a-4638-a457-105cfe00eb4f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:45.597248 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1983f344-3b7a-4638-a457-105cfe00eb4f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:45.598128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1983f344-3b7a-4638-a457-105cfe00eb4f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:45.599282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1983f344-3b7a-4638-a457-105cfe00eb4f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:45.599906 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1983f344-3b7a-4638-a457-105cfe00eb4f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:45.604904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=72 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:45.941615 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:45.946854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:45.962220 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:45.963028 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:45.967076 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:45.967806 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:46.018993 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lazy-loading 'flavor' on Instance uuid 4058a126-dae4-43c7-8270-12ea57ea38c6 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:24:46.301230 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5926584c-44e0-4b01-b012-d4bdea07de88 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6/action" status: 200 len: 32 microversion: 2.1 time: 0.363498 May 23 20:24:46.301869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 104/223] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:24:45 2022] POST /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6/action => generated 32 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 20:24:46.316358 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:46.317925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:46.327342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:46.327894 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:46.328749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:46.329505 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:46.556766 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:46.566431 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2f8b87fd-f861-42d0-9dc6-7833faad0ac3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.256104 May 23 20:24:46.567711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 105/224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:46 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:46.623815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1983f344-3b7a-4638-a457-105cfe00eb4f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.041296 May 23 20:24:46.629351 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 120/225] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:24:45 2022] POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:24:47.585328 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:47.585965 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:47.593049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:47.593542 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:47.594389 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:47.594786 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:47.754653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:47.768430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0c5965f3-28ed-49fa-ab5a-28496b7c73d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.186820 May 23 20:24:47.769343 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 106/226] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:47 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:48.789022 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:48.790247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:48.796596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:48.797663 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:48.799427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:48.799427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:49.023389 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:49.037700 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8eded61b-c792-4080-a182-c4bfa284af08 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.253436 May 23 20:24:49.038605 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 121/227] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:48 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:50.055617 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:50.056175 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:50.079049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:50.079774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:50.080726 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:50.081302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:50.256724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:50.269892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f3019a0e-8134-45b0-b1ca-2f0d26b93828 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.218144 May 23 20:24:50.280664 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 107/228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:50 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:51.290822 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:51.295276 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:51.302543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:51.305957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:51.307163 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:51.310494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:51.463882 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:51.472474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7e0c2e5c-4ad3-4218-ab6b-4f83c819b01a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.187749 May 23 20:24:51.483212 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 122/229] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:51 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:52.489436 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:52.490074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:52.507289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:52.510393 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:52.511463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:52.512148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:52.717196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:52.725608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9e112197-fe64-41cf-b3a2-4478ed6f5bf4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.240164 May 23 20:24:52.726186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 108/230] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:52 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:53.743394 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:53.744056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:53.751834 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:53.752292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:53.753075 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:53.753510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:53.981448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:53.990281 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ae4c5211-0767-4a2e-8408-d832272063e4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.250635 May 23 20:24:53.990861 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 123/231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:53 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:54.277381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cc5f06b8-115b-4cd5-ba35-01e3c09a8834 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Action: 'create', calling method: .version_select at 0x7f996d896820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2119033645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2ExLDForWybb7xjSmrdZMIXp8RGoiM7CeN0PqRtzLLK+muwoeENgqEJYAUPgvN3oh/maFLH33rCLk7qQ8G/kM+J1LaUpcec14ovHz4ICWtO2nE6Nka9CE0ZxGon+eP8w=="}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:54.294727 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-cc5f06b8-115b-4cd5-ba35-01e3c09a8834 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for project 26567fb564314003bf5ae836737b990e. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:24:54.300355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-cc5f06b8-115b-4cd5-ba35-01e3c09a8834 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for user 7231b60e5f9541629fec2291c547f0f4 and project 26567fb564314003bf5ae836737b990e. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:24:54.403527 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cc5f06b8-115b-4cd5-ba35-01e3c09a8834 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.326931 May 23 20:24:54.404127 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 109/232] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:24:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:55.007769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:55.008484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:55.016025 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:55.016473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:55.017241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:55.017674 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:55.173978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:55.182299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0c5efe36-27ff-47e8-b264-bace003d4088 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.178425 May 23 20:24:55.182875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 124/233] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:55 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:55.451977 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1b531005-a7e6-46d6-8d06-87a607af6957 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:55.452500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1b531005-a7e6-46d6-8d06-87a607af6957 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:55.460202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b531005-a7e6-46d6-8d06-87a607af6957 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:55.460649 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b531005-a7e6-46d6-8d06-87a607af6957 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:55.461438 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b531005-a7e6-46d6-8d06-87a607af6957 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:55.461872 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b531005-a7e6-46d6-8d06-87a607af6957 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:55.486061 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1b531005-a7e6-46d6-8d06-87a607af6957 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/ips" status: 200 len: 151 microversion: 2.20 time: 0.039163 May 23 20:24:55.486648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 110/234] 10.222.0.16 () {60 vars in 1288 bytes} [Mon May 23 20:24:55 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:24:56.201225 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:56.202626 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:56.209295 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:56.211307 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:56.211943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:56.213406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:56.213870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:56.357769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-447322aa-1c68-4194-8b2d-ed46770858f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:56.361462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-447322aa-1c68-4194-8b2d-ed46770858f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:56.376019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-447322aa-1c68-4194-8b2d-ed46770858f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:56.377638 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-447322aa-1c68-4194-8b2d-ed46770858f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:56.378689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-447322aa-1c68-4194-8b2d-ed46770858f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:56.381563 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-447322aa-1c68-4194-8b2d-ed46770858f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:56.418445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-447322aa-1c68-4194-8b2d-ed46770858f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/ips" status: 200 len: 149 microversion: 2.1 time: 0.065100 May 23 20:24:56.425104 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 111/235] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:24:56 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/ips => generated 149 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:24:56.492538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:56.502807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-70e398a2-9453-45e7-9635-58f5eadd1c9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.305566 May 23 20:24:56.512376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 125/236] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:56 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:57.521750 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:57.522424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:57.528682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:57.529653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:57.530468 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:57.530901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:57.733375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:57.752097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9c2095b1-660d-4537-8eea-8cd0665f4081 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.235618 May 23 20:24:57.753618 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 112/237] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:57 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:58.273860 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-baba4464-a696-4397-bceb-18ae2c139e85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b457781-8eca-472a-9ba1-faa63422d026"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:58.275079 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-baba4464-a696-4397-bceb-18ae2c139e85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:58.283978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-baba4464-a696-4397-bceb-18ae2c139e85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:58.289790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-baba4464-a696-4397-bceb-18ae2c139e85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:58.289790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-baba4464-a696-4397-bceb-18ae2c139e85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:58.289790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-baba4464-a696-4397-bceb-18ae2c139e85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:58.731393 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5cd6e02c-cc72-41ed-8918-8460876847bd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:58.738509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5cd6e02c-cc72-41ed-8918-8460876847bd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:58.738958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5cd6e02c-cc72-41ed-8918-8460876847bd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:58.802027 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5cd6e02c-cc72-41ed-8918-8460876847bd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Going to try to stop instance {{(pid=118171) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 20:24:58.992218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5cd6e02c-cc72-41ed-8918-8460876847bd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action" status: 202 len: 0 microversion: 2.1 time: 0.265539 May 23 20:24:58.992766 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 113/238] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:24:58 2022] POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 20:24:58.999158 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:58.999847 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:59.006203 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:59.006682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:59.007443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:59.007959 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:59.010969 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:59.091692 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-baba4464-a696-4397-bceb-18ae2c139e85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821476 May 23 20:24:59.092295 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 126/239] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:24:58 2022] POST /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:24:59.099984 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:24:59.101246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:59.118357 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:59.118806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:59.119580 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:59.121075 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:59.160318 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:59.168111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-13f7649c-0d2f-42c6-b9f0-7747c89ab447 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.173328 May 23 20:24:59.168725 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 114/240] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:58 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:59.284693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:24:59.292707 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d75cca18-5528-440b-8588-c66386ba9441 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.199252 May 23 20:24:59.293259 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 127/241] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:24:59 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:24:59.942607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:24:59.943403 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:24:59.945963 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:24:59.951036 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:59.951479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:59.956733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:24:59.956733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:24:59.976302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lazy-loading 'flavor' on Instance uuid 27d11af6-2834-47d4-92cc-ee3135a9f976 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:25:00.185209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:00.185834 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:00.193390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:00.194206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:00.194970 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:00.195398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:00.333816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:00.341178 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-894ec389-64b3-4260-b559-b374b1900d58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.159823 May 23 20:25:00.341729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 128/242] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:00 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:00.346158 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:00.346873 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:00.353526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:00.353973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:00.354894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:00.355328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:00.491586 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:00.499775 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bcd13253-a634-4b3b-979f-c4dbea068a33 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.157032 May 23 20:25:00.500346 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 129/243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:00 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:01.358928 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:01.359560 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:01.365961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:01.366436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:01.367192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:01.367622 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:01.499011 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:01.506675 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d28b756a-b07e-4a45-9997-295fa55e1e9f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.152370 May 23 20:25:01.507241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 130/244] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:01 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:01.516965 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:01.517579 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:01.523538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:01.523976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:01.524771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:01.525195 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:01.660480 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:01.668596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c24bdec5-1f2f-4ad3-98b5-8e9b0ced324a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.155902 May 23 20:25:01.669159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 131/245] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:01 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:02.331017 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-53e38c9e-dd4d-4853-8b50-90fc44056edd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/action" status: 202 len: 0 microversion: 2.20 time: 2.392348 May 23 20:25:02.332003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 115/246] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 20:24:59 2022] POST /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/action => generated 0 bytes in 2394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 20:25:02.340123 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:02.340813 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:02.347862 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:02.348399 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:02.349520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:02.350047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:02.492974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:02.501876 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:02.503417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:02.504605 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6d4ad2ec-b96a-4dda-ac57-76cbe71e806e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.168516 May 23 20:25:02.505148 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 132/247] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:02 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:02.525537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:02.526260 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:02.533733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:02.534242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:02.535006 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:02.535443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:02.665896 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:02.674065 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7352450c-f18a-42e5-b4d5-b8822260a02b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.152977 May 23 20:25:02.674639 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 116/248] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:02 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:02.835385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:02.835385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:02.835385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:02.835385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:02.837418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:02.837418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:02.837418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:02.840540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-133e8904-93a7-4a73-b38e-5fd0d8028d64 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.158412 May 23 20:25:02.841110 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 133/249] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:02 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:02.841263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-549795899", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-990032347", "security_groups": [{"name": "tempest-secgroup-smoke-1227438931"}], "networks": [{"uuid": "732ac238-a06b-44f4-b31c-125a3f37c7a7"}], "block_device_mapping_v2": [{"uuid": "b13ee7a0-8798-42f8-94f1-deb6d31bbbd0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:02.962081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] validate_networks() for [('732ac238-a06b-44f4-b31c-125a3f37c7a7', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:25:03.344444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:25:03.345030 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:25:03.345364 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:25:03.345770 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:25:03.346227 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:25:03.355303 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.355752 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.356535 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.356964 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.374271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Getting quotas for project d8f120eaf89b4ef29fc92cf544ff1000. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:25:03.378361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Getting quotas for user 3be98a16abca4b5ea9e54a29f9b4ea62 and project d8f120eaf89b4ef29fc92cf544ff1000. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:25:03.445060 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:25:03.447267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b13ee7a0-8798-42f8-94f1-deb6d31bbbd0',volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:25:03.525862 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:03.526629 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:03.532875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.533319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.534096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.534522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.537186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:03.675562 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:03.683672 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:03.687198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:03.688391 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e25db20d-35e9-4da0-8bd0-968292594b86 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.166598 May 23 20:25:03.689049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 134/250] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:03 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:03.693938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:03.695816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:03.701174 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.702413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.703249 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.703951 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.838004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:03.845537 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-53c43f5a-68d2-48db-816b-daa4e39d6dff tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.155337 May 23 20:25:03.846122 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 135/251] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:03 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:03.859366 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:03.859972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:03.866245 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.866629 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.866967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6d5d157a-a8ed-4b54-b6ef-a69d0c03ba4c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.029922 May 23 20:25:03.867389 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:03.873054 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:03.873218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 117/252] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:25:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 20:25:03.878780 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f20fc50d-9fc1-42df-9273-62146fd048e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:03.879429 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f20fc50d-9fc1-42df-9273-62146fd048e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:03.942322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f20fc50d-9fc1-42df-9273-62146fd048e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:03.949299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f20fc50d-9fc1-42df-9273-62146fd048e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1087 microversion: 2.1 time: 0.074261 May 23 20:25:03.951071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 118/253] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:03 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:04.050658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:04.058961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6c058990-3305-4c83-a558-3c96090d0504 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.203948 May 23 20:25:04.059527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 136/254] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:03 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:04.713908 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:04.713908 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:04.728384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:04.728766 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:04.729539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:04.729981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:04.863193 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:04.864436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:04.871466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:04.873583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:04.873583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:04.873583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:04.881725 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:04.890563 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:04.900057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:04.900057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-15cb24db-b5b6-471a-839b-3c5a87b56e57 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.184936 May 23 20:25:04.900057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 119/255] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:04 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:04.965768 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-948af88d-acca-4850-bc22-7efba03a49e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:04.966683 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-948af88d-acca-4850-bc22-7efba03a49e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:05.047808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-948af88d-acca-4850-bc22-7efba03a49e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:05.056588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-948af88d-acca-4850-bc22-7efba03a49e9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1087 microversion: 2.1 time: 0.094646 May 23 20:25:05.057309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 120/256] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:04 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1087 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:05.076647 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:05.077316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:05.085172 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:05.085619 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:05.086437 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:05.086869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:05.109656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:05.129242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-912b740f-76a4-4236-a3d6-cb381a100945 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.260343 May 23 20:25:05.129242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 137/257] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:04 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:05.240343 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:05.249000 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-536e9941-585a-4b8a-a91d-dcb6d1acfd16 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.176150 May 23 20:25:05.250458 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 121/258] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:05 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:05.913082 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:05.913794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:05.920688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:05.920825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:05.922179 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:05.922613 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:06.054919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:06.063537 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:06.065035 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:06.066251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4946156e-5d4f-4e3d-b81e-6a1b29794d16 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.157174 May 23 20:25:06.066795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 138/259] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:05 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:06.073642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:06.074283 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:06.082317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:06.084848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:06.084848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:06.084848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:06.136748 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:06.137367 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:06.144220 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:06.144886 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:06.145598 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:06.146044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:06.148964 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:06.157492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1af3dec6-2e9a-49b0-9cba-bb41d3537e95 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1129 microversion: 2.1 time: 0.087485 May 23 20:25:06.158073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 122/260] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:06 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1129 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:06.268565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:06.269066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:06.275941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:06.275941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:06.276209 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:06.276634 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:06.283630 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:06.291508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ca62dd17-e934-4991-b57d-7a00c188dc51 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.158565 May 23 20:25:06.292160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 139/261] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:06 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:06.411229 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:06.419511 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f7719abb-ccde-45d9-8fd8-9fc869e504a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.155366 May 23 20:25:06.420297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 123/262] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:06 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:07.085190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:07.086049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:07.093921 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.100384 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.100384 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.100384 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.178081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:07.178707 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:07.200105 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.200550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.203745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.204190 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.286553 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:07.295660 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-89981f06-1518-477c-bf00-3c7d25be9045 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1193 microversion: 2.1 time: 0.124695 May 23 20:25:07.296989 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 124/263] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:07 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1193 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:07.319962 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:07.320746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:07.322253 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:07.332136 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:07.333664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:07.334971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-78bd139f-8822-40eb-96d4-8cb3b3319c20 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.253781 May 23 20:25:07.336203 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.336917 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.338464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.339154 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.348559 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 140/264] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:07 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:07.446167 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:07.447685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:07.455492 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.455930 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.457283 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:07.458144 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:07.512156 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:07.519844 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-943ef95a-a3f8-4567-a27d-b76e90ef6fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.204636 May 23 20:25:07.520400 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 125/265] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:07 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:07.679853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:07.688258 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0f33635f-96b2-4880-8ec8-abc29dd21700 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.255334 May 23 20:25:07.688934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 141/266] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:07 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:07.720790 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4eea5617-737c-4585-88ca-b3c2c36ccb17 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: .version_select at 0x7f996d7181f0>, body: {"keypair": {"name": "tempest-keypair-2122432326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Mz6LN2gmuINVuMwufRP7hoeEEcbupEkP13Hb2+6MmTsmESUcknwO+e2PQ30UNEG8jUfsbRmgaVSvB874GkDg/JVGT9Cl0Wo91TsvLGBBMKxZgez04kCmIZv9/UdntcA=="}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:07.735191 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-4eea5617-737c-4585-88ca-b3c2c36ccb17 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:25:07.739080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-4eea5617-737c-4585-88ca-b3c2c36ccb17 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:25:07.895085 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4eea5617-737c-4585-88ca-b3c2c36ccb17 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178049 May 23 20:25:07.895690 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 126/267] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:25:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:08.313888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:08.315139 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:08.322480 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.322930 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.323715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.324138 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.353766 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:08.354381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:08.363326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.364132 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.368531 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.371714 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.492036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:08.506874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b3dbe7e1-a80f-423b-bb15-92ad29348622 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1271 microversion: 2.1 time: 0.197592 May 23 20:25:08.507663 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 142/268] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:08 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:08.533577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:08.537028 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:08.537641 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:08.541807 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:08.543460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:08.543741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.544189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.544823 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2f9eb200-5f07-4a85-9c59-37914a939682 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.195779 May 23 20:25:08.544949 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.545380 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.545564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 127/269] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:08 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:08.692972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:08.708897 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-97a8b178-0767-4ff2-9d41-781731e0a1cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.175399 May 23 20:25:08.710244 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 143/270] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:08 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:08.710749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:08.711371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:08.717801 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.721778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.721778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:08.721778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:08.878152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:08.887507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a5c8262c-45f2-4080-b6e0-4182bfd0dfab tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.185788 May 23 20:25:08.888197 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 128/271] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:08 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:09.524794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:09.526042 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:09.533659 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.534138 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:09.534917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.535393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:09.563738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:09.564876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:09.578168 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.578956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:09.579729 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.580159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:09.675028 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:09.682654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c10fa7f5-f20b-48fc-ba3d-4817be946492 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1271 microversion: 2.1 time: 0.162720 May 23 20:25:09.683227 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 144/272] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:09 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:09.726356 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:09.727055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:09.733110 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.734826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:09.735010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.735426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:09.792288 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:09.802917 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:09.804668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:09.805899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-15c61f76-37bb-4975-b2a3-3acaf63e1bda tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.246202 May 23 20:25:09.813365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 129/273] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:09 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:09.877957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:09.886115 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ab5e9b8a-c7c2-4a61-a84a-718c20b9d759 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.163562 May 23 20:25:09.886677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 145/274] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:09 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:09.904925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:09.906921 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:09.911902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.912348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:09.913203 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:09.913634 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:10.120747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:10.129929 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b6b37917-9635-4cfd-89e9-a8da21323f85 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.229129 May 23 20:25:10.130529 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 130/275] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:09 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:10.352930 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-759414060", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e834b06-191b-4f74-93c9-403bb39ced80"}], "security_groups": [{"name": "tempest-securitygroup--1993169838"}], "key_name": "tempest-keypair-2122432326", "user_data": "}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:10.451683 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] validate_networks() for [('2e834b06-191b-4f74-93c9-403bb39ced80', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:25:10.700150 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:10.700751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:10.707381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:10.707819 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:10.708571 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:10.708995 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:10.842763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:10.851774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bdb99edb-366a-41e2-b47f-31dbe7d609ea tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1271 microversion: 2.1 time: 0.155365 May 23 20:25:10.852363 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 131/276] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:10 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:10.857050 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:10.857645 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:10.866668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:10.866668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:10.866668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:10.866668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:10.882238 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:11.003185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:11.010960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:11.012470 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:11.013626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2d2683ee-418f-4dce-a3b6-6c5c582a452e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.160346 May 23 20:25:11.014388 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 132/277] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:10 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:11.024486 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:11.025092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:11.031884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.036129 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.036129 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.036129 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.114197 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:25:11.115235 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:25:11.115968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:25:11.116383 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:25:11.116850 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:25:11.128485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.128931 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.129913 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.130764 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.151209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:25:11.155351 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:25:11.166563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:25:11.168911 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:25:11.174730 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:11.182501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3422ae65-fb2a-4dbf-a626-6bf650b558cf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.162841 May 23 20:25:11.183357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 133/278] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:11 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:11.188502 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:11.189107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:11.196233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.196849 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.197652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.198130 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.300256 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d7d482b5-902b-4466-a7d1-23c246ff6d84 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.951451 May 23 20:25:11.305798 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 146/279] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:25:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:25:11.312295 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-82517a46-0d37-4bb7-80b2-73c5a85e9ff8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:11.312921 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-82517a46-0d37-4bb7-80b2-73c5a85e9ff8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:11.388262 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:11.391874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-82517a46-0d37-4bb7-80b2-73c5a85e9ff8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:11.401189 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f250c1b8-fdac-48b4-8625-025d7656c64d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.216794 May 23 20:25:11.412456 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 134/280] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:11 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:11.412793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-82517a46-0d37-4bb7-80b2-73c5a85e9ff8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1241 microversion: 2.1 time: 0.099569 May 23 20:25:11.412793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 147/281] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:11 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:11.713728 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-287354e4-3b76-477f-84a1-e3d7f6b97363 req-d1b3c08b-8b4b-4cf6-b7e9-5cf7c2ed9e0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18", "tag": "e3fbb816-fd5a-4989-8f75-4be912227768"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:11.737843 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-287354e4-3b76-477f-84a1-e3d7f6b97363 req-d1b3c08b-8b4b-4cf6-b7e9-5cf7c2ed9e0a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.738417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-287354e4-3b76-477f-84a1-e3d7f6b97363 req-d1b3c08b-8b4b-4cf6-b7e9-5cf7c2ed9e0a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.759575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-287354e4-3b76-477f-84a1-e3d7f6b97363 req-d1b3c08b-8b4b-4cf6-b7e9-5cf7c2ed9e0a service nova] Creating event network-changed:e3fbb816-fd5a-4989-8f75-4be912227768 for instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 on hv-cinder-84301 May 23 20:25:11.770874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-287354e4-3b76-477f-84a1-e3d7f6b97363 req-d1b3c08b-8b4b-4cf6-b7e9-5cf7c2ed9e0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060773 May 23 20:25:11.771925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 135/282] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:11.869067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:11.869600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:11.886911 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.887818 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:11.891549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:11.892292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.038484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:12.040886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:12.063509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.064134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.064997 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.065502 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.108836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:12.134549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ed64c6ab-e9b5-40d1-a4ed-a1d3006194cc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1271 microversion: 2.1 time: 0.269269 May 23 20:25:12.135217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 148/283] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:11 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:12.201087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:12.201722 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:12.224152 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.227874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.230099 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.230820 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.288580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:12.307787 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:12.310933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:12.310933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-826f0635-487d-4019-b5a7-36570587db2d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.281277 May 23 20:25:12.311502 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 136/284] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:12 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:12.420801 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:12.421363 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:12.451681 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.452196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.453743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.454382 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.482776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:12.492619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-413114f4-8ab7-4f8b-b8bb-a30e1418fdd0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.294804 May 23 20:25:12.504778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 149/285] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:12 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:12.510982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:12.512794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:12.520498 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.521042 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.521894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:12.522351 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:12.601447 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:12.609785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:12.610035 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-48be38aa-23d2-4dd1-971c-d1314eccb285 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1245 microversion: 2.1 time: 0.103918 May 23 20:25:12.611116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 150/286] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:12 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1245 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:12.618736 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3ad58d90-3fe7-4ea5-9838-bbe9c61c5b0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.201935 May 23 20:25:12.619494 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 137/287] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:12 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:13.155751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:13.157209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:13.166586 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.167240 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.168007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.168443 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.330050 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:13.330661 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:13.331920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:13.337749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.338392 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.339697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.340126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.340466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d9d85e16-38fe-4da0-bff3-a7a0deb91ee0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.188975 May 23 20:25:13.341087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 151/288] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:13 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:13.366064 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:13.491072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:13.500393 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:13.501935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:13.503185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e381e8e2-8e7f-4b0b-9618-ece9a70d8390 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.177945 May 23 20:25:13.505396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 138/289] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:13 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:13.511863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:13.512574 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:13.519890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.520818 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.521793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.522458 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.540942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:13.629880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:13.630838 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:13.637856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.638554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.654377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.655583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.745558 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:13.754532 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4697777d-bdaf-46ed-bb20-0357b8a50b2e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1293 microversion: 2.1 time: 0.130488 May 23 20:25:13.755099 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 139/290] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:13 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1293 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:13.768323 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:13.768323 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:13.768623 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:13.768863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.768863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.768863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:13.769419 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:13.777755 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3297119f-62df-46c6-94a6-e5afb8aa3dc1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.270211 May 23 20:25:13.789268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 152/291] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:13 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:13.989349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:14.001862 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3a85d6f1-b7b3-4583-be40-c16a563e714d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.245355 May 23 20:25:14.002792 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 140/292] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:13 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:14.361869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:14.362509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:14.372482 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.373026 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.374297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.374951 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.509737 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:14.518534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-63f6beec-fdd8-4ab5-b6e0-65a55d9ab031 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.160457 May 23 20:25:14.519488 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 153/293] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:14 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:14.521530 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:14.522579 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:14.529467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.529911 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.531570 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.532006 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.756041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:14.765198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:14.766774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:14.768120 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ddce37e3-3ef7-40ef-ab6e-990ec50b05c4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.250847 May 23 20:25:14.774192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 141/294] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:14 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:14.782270 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:14.782885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:14.788997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.789371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.790466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.790907 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.797317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:14.797958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:14.804303 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.804754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.805524 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:14.805983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:14.948982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:14.957885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8f12a24e-6077-4ffe-af66-012edd1ec932 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.180595 May 23 20:25:14.958634 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 154/295] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:14 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:15.006562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:15.019990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:15.021174 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c5d530b9-3249-4448-b5fb-e30ba595a016 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.229539 May 23 20:25:15.021347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:15.021926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 142/296] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:14 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:15.027448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.028094 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.029022 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.029600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.158569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:15.166961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-40ce8991-4b2e-4da2-90c3-f23de6e25173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.150762 May 23 20:25:15.167461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 155/297] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:15 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:15.535703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:15.536311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:15.543076 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.543530 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.544307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.544922 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.706238 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:15.713897 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-39efaad0-60c2-4787-be6d-662226167448 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.181952 May 23 20:25:15.714427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 143/298] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:15 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:15.788846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:15.790743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:15.797948 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.798427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.799278 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.799706 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.816392 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-65c12b0d-4b28-49b7-baec-59cdf9e25410 req-59c5648a-892a-4848-ad22-50e0f80d9ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c2e8cd-3178-4528-b5b1-db0638467714", "tag": "ef2feccf-3cf9-483a-be18-bb3f720aec9c"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:15.827605 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-65c12b0d-4b28-49b7-baec-59cdf9e25410 req-59c5648a-892a-4848-ad22-50e0f80d9ecb service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.828442 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-65c12b0d-4b28-49b7-baec-59cdf9e25410 req-59c5648a-892a-4848-ad22-50e0f80d9ecb service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.847460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-65c12b0d-4b28-49b7-baec-59cdf9e25410 req-59c5648a-892a-4848-ad22-50e0f80d9ecb service nova] Creating event network-changed:ef2feccf-3cf9-483a-be18-bb3f720aec9c for instance 51c2e8cd-3178-4528-b5b1-db0638467714 on hv-cinder-84301 May 23 20:25:15.853113 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-65c12b0d-4b28-49b7-baec-59cdf9e25410 req-59c5648a-892a-4848-ad22-50e0f80d9ecb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044724 May 23 20:25:15.854179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 144/299] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:15.958932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:15.967315 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:15.969664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:15.972252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ae7b0eff-4c49-4bd1-bd15-de73c6761b61 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.187465 May 23 20:25:15.972851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 156/300] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:15 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:15.977277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:15.978045 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:15.985078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.985525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:15.986599 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:15.987296 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:16.040035 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:16.040656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:16.051782 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:16.052176 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:16.053153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:16.053815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:16.195256 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:16.204077 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b7e7ca0f-f90e-454a-b6f7-adc915e77f70 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.168711 May 23 20:25:16.204638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 157/301] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:16 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:16.210002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:16.217064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:16.234901 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:16.235367 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:16.236707 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:16.237238 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:16.372186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:16.381436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7d68e017-fcbf-42e1-829f-b1d871da73c2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.175612 May 23 20:25:16.395046 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 158/302] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:16 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:16.468678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:16.478416 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5f20c716-9012-4604-8198-d3af283b8888 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.505553 May 23 20:25:16.486673 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 145/303] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:15 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:16.732519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:16.732519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:16.739268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:16.739930 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:16.751153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:16.751153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:16.891073 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:16.899342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-01cd7701-84f1-460e-9495-5520cffb3dad tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.171973 May 23 20:25:16.899906 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 159/304] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:16 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:16.990525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:16.991259 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:16.997961 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:16.998617 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.001748 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.003452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.135095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:17.143622 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:17.145107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:17.146282 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-01605a46-fca5-474a-8941-1957e6dfb377 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.159830 May 23 20:25:17.146990 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 146/305] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:16 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:17.220860 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:17.221868 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:17.228130 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.228569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.229938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.229938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.359658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:17.367020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7ad01ada-02ec-414c-923e-e942505eb746 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.150295 May 23 20:25:17.367575 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 160/306] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:17 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:17.402036 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:17.402643 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:17.409034 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.409476 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.410385 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.410840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.496501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:17.497081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:17.503676 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.507055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.507055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.507055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.605044 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:17.614745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-00be474f-2a96-4bfe-8bfb-e6597567a546 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.216653 May 23 20:25:17.615830 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 147/307] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:17 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:17.650322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:17.658334 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-fe047e83-3077-4585-a7cc-98251a8e98ee tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.166229 May 23 20:25:17.658890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 161/308] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:17 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:17.916678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:17.917278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:17.919254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=18 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:17.924655 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.925098 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:17.925849 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:17.926312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.059855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:18.067501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1b4ea587-cba6-45ad-8e08-98c52befcf50 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.154737 May 23 20:25:18.068063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 148/309] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:17 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:18.164482 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:18.165089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:18.171614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.172059 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.172815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.173244 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.315638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:18.323673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:18.325324 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:18.326501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b6a82a19-cf10-4bb7-b044-ce166304058f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.165945 May 23 20:25:18.327578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 162/310] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:18 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:18.384299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:18.384922 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:18.391506 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.391952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.392714 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.393147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.531603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:18.543388 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6cc9f299-2686-457a-a010-fed8dccc36f1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.159251 May 23 20:25:18.548496 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 149/311] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:18 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:18.632713 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:18.633463 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:18.641838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.642308 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.643449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.643790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.675588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:18.676437 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:18.678472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:18.683802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.684254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.685189 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:18.685630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:18.704098 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:18.836429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:18.846131 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-567c3fcd-e807-4c54-880a-6adab34a964d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.217514 May 23 20:25:18.847212 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 163/312] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:18 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:18.851907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:18.860619 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a083a918-c09d-4c82-856d-4a12bf6befc7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.189053 May 23 20:25:18.861507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 150/313] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:18 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:19.084498 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:19.085285 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:19.092360 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.092806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.093559 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.093992 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.244986 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:19.256912 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-799a637e-1da6-4724-8672-4f06f54fa376 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.176242 May 23 20:25:19.258147 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 164/314] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:19 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:19.345219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:19.345759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:19.351735 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.352180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.352939 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.353372 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.482747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:19.491602 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:19.493379 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:19.494557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-25e37e8e-5b8e-464c-b494-e24940dff15c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.153830 May 23 20:25:19.495101 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 151/315] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:19 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:19.565578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:19.566895 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:19.578071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.578071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.578071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.578071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.753101 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:19.762141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9d055ebb-6b9f-4b5b-8613-c23ace72c536 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.199775 May 23 20:25:19.762141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 165/316] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:19 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:19.784733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2097667114", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2119033645", "security_groups": [{"name": "tempest-secgroup-smoke-560179066"}], "block_device_mapping_v2": [{"uuid": "6174effb-0f6b-4734-a2f2-2994c860df4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d1b674a5-f902-453a-bbbe-6a61eb453929"}]}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:19.865123 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:19.865640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:19.867484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:19.874819 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.875256 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.876026 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:19.876450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:19.909677 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] validate_networks() for [('d1b674a5-f902-453a-bbbe-6a61eb453929', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:25:20.031632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:20.041034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7b08ec68-4230-4604-8eda-fec3d846eee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1718 microversion: 2.1 time: 0.180095 May 23 20:25:20.041971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 166/317] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:19 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:20.056731 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:20.057485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:20.064674 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.065305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.066385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.066972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.206474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:20.215527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-97cdf2c0-4a8f-463b-80cb-8e5dcfbafe8e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.172443 May 23 20:25:20.216093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 167/318] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:20 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:20.280773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:20.282898 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:20.290619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.291740 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.292072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.292681 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.320881 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:25:20.321171 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:25:20.321785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:25:20.322618 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:25:20.323041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:25:20.335130 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.335980 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.336812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.337305 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.376426 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for project 26567fb564314003bf5ae836737b990e. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:25:20.380570 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for user 7231b60e5f9541629fec2291c547f0f4 and project 26567fb564314003bf5ae836737b990e. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:25:20.447499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:20.455272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:25:20.457459 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6174effb-0f6b-4734-a2f2-2994c860df4c',volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:25:20.462651 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-224ea879-30ef-4688-8e77-ce628c8f89ec tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.187215 May 23 20:25:20.463364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 168/319] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:20 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:20.517137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:20.517932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:20.524432 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.525217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.526165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.526741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.551134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:20.687297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:20.696519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:20.698257 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:20.699597 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f8c3744c-6c67-4c0f-8db8-19e239acdb7d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.188053 May 23 20:25:20.700590 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 169/320] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:20 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:20.778699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:20.779312 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:20.785304 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.785775 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.786568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:20.787005 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:20.938239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:20.949146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ec2ca8c3-ab1d-4641-a684-e89946e43cbc tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.174180 May 23 20:25:20.950272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 170/321] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:20 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:21.017894 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-70037c8a-e107-451e-87a2-a1e7a1e68af5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.237624 May 23 20:25:21.019277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 152/322] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:25:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:25:21.029032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6267487a-6ca0-4446-978e-a1c6d17208ac tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:21.029743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6267487a-6ca0-4446-978e-a1c6d17208ac tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:21.060775 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:21.062821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:21.075966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.076429 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.077370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.077815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.099084 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6267487a-6ca0-4446-978e-a1c6d17208ac tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.107189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6267487a-6ca0-4446-978e-a1c6d17208ac tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1095 microversion: 2.1 time: 0.082009 May 23 20:25:21.107771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 171/323] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:21 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:21.232650 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:21.233888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:21.235844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:21.241740 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.242271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.243045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.243774 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.267932 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.278434 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7d3dadb7-a3a3-4ce3-ae5e-13b09a38ccf6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1695 microversion: 2.1 time: 0.224126 May 23 20:25:21.279322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 153/324] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:21 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:21.311018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fdc7a17e-5908-4cbf-98fb-379919c3e161 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:21.317113 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fdc7a17e-5908-4cbf-98fb-379919c3e161 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.317741 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fdc7a17e-5908-4cbf-98fb-379919c3e161 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.345215 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fdc7a17e-5908-4cbf-98fb-379919c3e161 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Going to try to start instance {{(pid=118171) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 20:25:21.402302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.411495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-744a865e-872e-4dfc-b557-836cea15d91d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.182822 May 23 20:25:21.421251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 172/325] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:21 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:21.479873 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:21.481287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:21.486740 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.487333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.488321 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.488753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.587903 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fdc7a17e-5908-4cbf-98fb-379919c3e161 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action" status: 202 len: 0 microversion: 2.1 time: 0.280587 May 23 20:25:21.588712 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 154/326] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:25:21 2022] POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:25:21.598891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:21.599701 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:21.606737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.607395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.608365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.608803 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.664028 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.672349 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-54e806cd-e9cb-4753-ac8f-df431e22612a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.196926 May 23 20:25:21.673030 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 173/327] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:21 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:21.719728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:21.720524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:21.728966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.729670 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.730614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.731189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.792122 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.803104 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4204807f-7053-4c15-a656-a5efe4c5676a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1704 microversion: 2.1 time: 0.209999 May 23 20:25:21.803851 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 155/328] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:21 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1704 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:21.903179 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.912758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.914561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:21.915797 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a5420e8b-595d-421a-bb9f-d620c570fed0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.200173 May 23 20:25:21.916773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 174/329] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:21 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:21.968795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:21.969673 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:21.977716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.978874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:21.980629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:21.981583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.125057 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ab33c017-75d7-41b2-ab7f-6f7fad703353 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:22.125841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ab33c017-75d7-41b2-ab7f-6f7fad703353 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:22.191333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ab33c017-75d7-41b2-ab7f-6f7fad703353 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:22.198667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ab33c017-75d7-41b2-ab7f-6f7fad703353 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1095 microversion: 2.1 time: 0.078273 May 23 20:25:22.199644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 175/330] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:22 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:22.219901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:22.228785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-174c597f-9252-4746-8389-bebe7de9006a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.265465 May 23 20:25:22.229377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 156/331] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:21 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:22.428540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:22.429248 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:22.437412 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.437909 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.438816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.439470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.590514 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:22.598542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3c4706a7-6001-466e-b417-34c11cbb858a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.173869 May 23 20:25:22.600369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 176/332] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:22 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:22.601029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1863633539", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:22.652877 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] validate_networks() for None {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:25:22.693291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:22.694080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:22.700475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.702146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.702146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.702701 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.845153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:22.853457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8b17b5ed-efa2-4ec0-a56c-55d0addbb21d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.164131 May 23 20:25:22.854299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 177/333] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:22 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:22.859593 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:22.860197 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:22.866467 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.866923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.868540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.868540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.946723 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:25:22.947138 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:25:22.947608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:25:22.948003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:25:22.948406 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:25:22.957608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.958073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.958853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:22.959277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:22.978032 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Getting quotas for project cd6e338db3274331b7ab0a7370027f24. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:25:22.984368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Getting quotas for user c7b51b4971194a23ab8a16c823843c58 and project cd6e338db3274331b7ab0a7370027f24. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:25:23.000212 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:25:23.002722 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:25:23.008697 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.017123 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cac18698-1ee0-403a-a829-687431d9d017 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1704 microversion: 2.1 time: 0.161818 May 23 20:25:23.017676 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 178/334] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:22 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1704 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:23.022263 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:23.022943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:23.030608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.031053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.031818 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.032291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.139755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-46f70a85-fb07-4d7d-9508-4fca6320cb20 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542494 May 23 20:25:23.140736 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 157/335] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 20:25:23.151724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1d3bcc0b-51dc-454e-b8d2-dee0953e49f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:23.152813 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1d3bcc0b-51dc-454e-b8d2-dee0953e49f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:23.174647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.183988 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.185500 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.186847 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-15c63454-31f5-46ee-bb39-7b78677eba14 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.168206 May 23 20:25:23.194176 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 179/336] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:23 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:23.208014 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1d3bcc0b-51dc-454e-b8d2-dee0953e49f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.217848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1d3bcc0b-51dc-454e-b8d2-dee0953e49f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1215 microversion: 2.1 time: 0.070807 May 23 20:25:23.220321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 158/337] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:23 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:23.223529 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:23.230369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:23.238939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.239526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.240705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.241058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.247309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:23.250491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:23.254603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.255241 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.256728 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.257306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.313542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.321515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e80eac33-3801-4789-b8f1-839427146dd9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1193 microversion: 2.1 time: 0.109249 May 23 20:25:23.322292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 180/338] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:23 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:23.394799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.402343 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c302e3f3-12e2-440b-bb08-3c5823c3f269 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.159682 May 23 20:25:23.402898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 159/339] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:23 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:23.623266 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:23.624497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:23.632501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.633234 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.634282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.635189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.689739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-e572e2e5-94ed-42ea-9ed6-0b02f5cc5cdc req-f9799950-9953-4b4c-9b05-5c03e58114c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c2e8cd-3178-4528-b5b1-db0638467714", "name": "network-vif-plugged", "status": "completed", "tag": "ef2feccf-3cf9-483a-be18-bb3f720aec9c"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:23.698501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-e572e2e5-94ed-42ea-9ed6-0b02f5cc5cdc req-f9799950-9953-4b4c-9b05-5c03e58114c6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.698946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-e572e2e5-94ed-42ea-9ed6-0b02f5cc5cdc req-f9799950-9953-4b4c-9b05-5c03e58114c6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.718152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-e572e2e5-94ed-42ea-9ed6-0b02f5cc5cdc req-f9799950-9953-4b4c-9b05-5c03e58114c6 service nova] Creating event network-vif-plugged:ef2feccf-3cf9-483a-be18-bb3f720aec9c for instance 51c2e8cd-3178-4528-b5b1-db0638467714 on hv-cinder-84301 May 23 20:25:23.718152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-e572e2e5-94ed-42ea-9ed6-0b02f5cc5cdc req-f9799950-9953-4b4c-9b05-5c03e58114c6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032750 May 23 20:25:23.718742 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 160/340] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:25:23.785470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:23.794426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bfa746db-8cf1-434f-b2ae-8b154f90e787 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.177239 May 23 20:25:23.795542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 181/341] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:23 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:23.874412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:23.874412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:23.879065 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.879512 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:23.880273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:23.880697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.034141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:24.034749 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:24.039839 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.051009 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d855a085-c4c1-49ea-8a86-36a5ab3c1ad3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.183551 May 23 20:25:24.051580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 161/342] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:23 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:24.052863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.053512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.054468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.055072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.202053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.205859 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:24.206825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:24.208697 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-686d6176-3889-4df3-8e79-da8e2c2fbb96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1708 microversion: 2.1 time: 0.178699 May 23 20:25:24.209566 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 182/343] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:24 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1708 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:24.216347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.216799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.217674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.218301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.239871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:24.240499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:24.254680 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.255143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.258426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.260279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.344959 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.354446 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-86ba6a68-76e5-4d73-939b-61b5ae16a94e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1219 microversion: 2.1 time: 0.121572 May 23 20:25:24.356005 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 183/344] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:24 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:24.370148 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:24.370936 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:24.382473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.383251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.384265 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.384851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.466306 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.475270 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-759b4cc8-8863-4b66-81bc-344fa6f933bc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1193 microversion: 2.1 time: 0.118033 May 23 20:25:24.484903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 184/345] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:24 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1193 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:24.490099 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:24.490794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:24.497779 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.498253 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.499550 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.499748 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.505997 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.514518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.516018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.517375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-50204138-990f-4bf2-add3-731bd3ffb24c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1744 microversion: 2.20 time: 0.316495 May 23 20:25:24.517919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 162/346] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:24 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1744 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:24.638778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.647133 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b2659d44-ccd2-480e-aa4a-8feb8f25a44e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.169712 May 23 20:25:24.649591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 185/347] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:24 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:24.814645 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:24.816410 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:24.825856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.828391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.831540 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:24.832055 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:24.969750 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:24.980981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-aee613f7-096c-4db9-8df0-09199b9a9996 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.171180 May 23 20:25:24.980981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 163/348] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:24 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:25.067795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:25.068406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:25.074472 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.074919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.077271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.077271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.209785 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:25.217300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e0a3ee03-a34a-43cd-9231-064898395696 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.153528 May 23 20:25:25.217874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 186/349] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:25 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:25.372462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:25.373018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:25.379394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.379836 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.380583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.381019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.439229 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:25.446486 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6211ffcd-8096-451e-b31c-c3917240a614 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1211 microversion: 2.1 time: 0.077914 May 23 20:25:25.447035 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 164/350] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:25 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1211 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:25.491508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:25.492117 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:25.498069 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.498517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.499876 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.500318 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.539136 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:25.539743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:25.546187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.546633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.547391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.547828 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.558929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:25.561141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:25.567755 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d1927130-e4e4-4a3c-a51d-0f5da401cb33 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1201 microversion: 2.1 time: 0.080007 May 23 20:25:25.574302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 187/351] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:25 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1201 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:25.665948 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:25.666607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:25.674407 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:25.674693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.675167 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.675927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.676352 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.682751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:25.684510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:25.685849 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7b8e61e8-046d-4e33-b430-8ccd4334b63e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1744 microversion: 2.20 time: 0.150510 May 23 20:25:25.687534 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 165/352] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:25 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:25.733377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-919be2a1-ed53-47e7-a97b-9533921cafbf req-d14b4b8a-ba58-479e-b4d2-0075c0b2106d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18", "name": "network-vif-plugged", "status": "completed", "tag": "e3fbb816-fd5a-4989-8f75-4be912227768"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:25.742247 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-919be2a1-ed53-47e7-a97b-9533921cafbf req-d14b4b8a-ba58-479e-b4d2-0075c0b2106d service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:25.742925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-919be2a1-ed53-47e7-a97b-9533921cafbf req-d14b4b8a-ba58-479e-b4d2-0075c0b2106d service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:25.755151 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-919be2a1-ed53-47e7-a97b-9533921cafbf req-d14b4b8a-ba58-479e-b4d2-0075c0b2106d service nova] Creating event network-vif-plugged:e3fbb816-fd5a-4989-8f75-4be912227768 for instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 on hv-cinder-84301 May 23 20:25:25.760500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-919be2a1-ed53-47e7-a97b-9533921cafbf req-d14b4b8a-ba58-479e-b4d2-0075c0b2106d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031380 May 23 20:25:25.761101 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 166/353] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:25:25.812136 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:25.819466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2e03a786-da47-4374-9b9e-a42278983768 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.157478 May 23 20:25:25.820019 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 188/354] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:25 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:25.996152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:25.996841 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:26.004990 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.005435 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.006222 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.006656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.141421 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:26.149151 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-57781a36-3e04-4e3a-8a41-6935303e8cf4 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.157167 May 23 20:25:26.149709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 167/355] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:25 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:26.234699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:26.235328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:26.241332 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.241769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.242557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.242986 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.372947 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:26.380401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e8c7fead-8fe9-4aea-8091-67f657ca3230 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.150166 May 23 20:25:26.380962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 189/356] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:26 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:26.465737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:26.466371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:26.474255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.474951 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.476196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.476819 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.553375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:26.562609 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5fd7695d-8e9e-4336-a6be-9eb6eeafe462 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1211 microversion: 2.1 time: 0.102391 May 23 20:25:26.563187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 168/357] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:26 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:26.591627 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:26.591627 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:26.598781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.599228 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.599990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.600607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.702664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:26.706696 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:26.707363 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:26.712476 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-18558241-21d1-4011-afcf-eb5954cb1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1211 microversion: 2.1 time: 0.126170 May 23 20:25:26.722838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 190/358] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:26 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1211 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:26.724654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.725545 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.726891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.727560 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.839636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:26.840538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:26.857989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.858600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.859625 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:26.860159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:26.950802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:26.958448 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:26.962592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:26.964514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:26.972982 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e850c4fd-53d3-45b4-a1a4-56e20b102594 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1744 microversion: 2.20 time: 0.265128 May 23 20:25:26.972982 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 169/359] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:26 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1744 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:27.038757 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:27.047351 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-31ae2eb6-728f-451a-8814-3a5772782da1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.214550 May 23 20:25:27.047917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 191/360] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:26 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:27.167697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:27.168497 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:27.179292 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.179748 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.180529 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.180965 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.379383 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:27.386830 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d43a180f-b2b2-4511-b3f3-23eb511054cd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.223693 May 23 20:25:27.387379 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 170/361] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:27 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:27.399769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:27.400414 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:27.407505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.407505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.408217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.408650 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.547158 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:27.555201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-604faa68-c441-4dc1-a82a-f08a057b36bc tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.159195 May 23 20:25:27.556654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 192/362] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:27 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:27.580095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:27.580739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:27.587289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.587741 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.588510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.588941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.729848 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:27.730665 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:27.738326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.738872 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.739720 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.740230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.877255 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:27.884795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-115426c5-6275-482e-b434-efffde3ef894 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1278 microversion: 2.1 time: 0.158835 May 23 20:25:27.885353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 193/363] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:27 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:27.894000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-e74b121a-8f2a-4651-9e26-d9a7336da29b req-c103a332-cc3b-4a76-b095-2c015dd43313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d11af6-2834-47d4-92cc-ee3135a9f976", "name": "network-vif-plugged", "status": "completed", "tag": "f9e2fedd-ed41-4d66-9fcb-34b45c5b6538"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:27.897505 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:27.898204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-e74b121a-8f2a-4651-9e26-d9a7336da29b req-c103a332-cc3b-4a76-b095-2c015dd43313 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.898645 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-e74b121a-8f2a-4651-9e26-d9a7336da29b req-c103a332-cc3b-4a76-b095-2c015dd43313 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.905674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0c0f425d-2f02-4d1e-b657-3f6e10c009f0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1267 microversion: 2.1 time: 0.329236 May 23 20:25:27.906260 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 171/364] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:27 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:27.910932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-e74b121a-8f2a-4651-9e26-d9a7336da29b req-c103a332-cc3b-4a76-b095-2c015dd43313 service nova] Creating event network-vif-plugged:f9e2fedd-ed41-4d66-9fcb-34b45c5b6538 for instance 27d11af6-2834-47d4-92cc-ee3135a9f976 on hv-cinder-84301 May 23 20:25:27.916434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-e74b121a-8f2a-4651-9e26-d9a7336da29b req-c103a332-cc3b-4a76-b095-2c015dd43313 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029666 May 23 20:25:27.916997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 194/365] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:27.985486 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:27.986139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:27.992337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.992870 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:27.993701 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:27.994267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.065469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:28.066272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:28.072584 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.073029 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.073792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.074249 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.122246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:28.131743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:28.133294 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:28.134470 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7152f9ab-9eb7-4fc2-b387-07299ba46bf2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1744 microversion: 2.20 time: 0.152977 May 23 20:25:28.138228 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 172/366] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:27 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:28.204079 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:28.211341 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d51e67cc-af04-4d71-99cf-ccf3fc65fd3f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.150657 May 23 20:25:28.211892 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 195/367] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:28 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:28.403564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:28.404173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:28.410671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.411120 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.411887 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.412321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.539223 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:28.547282 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-13b3dd0e-b97c-4f3a-a68d-ff5ec5ebe0f0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.147621 May 23 20:25:28.547845 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 173/368] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:28 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:28.572495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:28.573097 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:28.579288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.579729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.580474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.580903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.710680 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:28.717974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5820df1d-383e-425e-b7d7-5487964e243d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.149301 May 23 20:25:28.718542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 196/369] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:28 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:28.901996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:28.902617 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:28.909144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.909585 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.910376 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.910804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.922332 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:28.922941 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:28.929915 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.930537 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.931320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:28.931745 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:28.993501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.001340 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9210ab62-0cba-41a8-a3e2-fe370eaf5e29 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1267 microversion: 2.1 time: 0.083249 May 23 20:25:29.001911 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 197/370] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:28 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:29.039626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.048411 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-07fc3034-8d23-4b3b-a9c6-a9a9c29a9623 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1278 microversion: 2.1 time: 0.150410 May 23 20:25:29.048981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 174/371] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:28 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:29.152743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:29.153344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:29.159814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.160251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.160995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.161426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.228523 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:29.229148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:29.235963 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.236400 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.237150 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.237579 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.288031 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.296067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.297552 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.298733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d894c531-08f3-4478-ba7b-1997af1ae598 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1744 microversion: 2.20 time: 0.150047 May 23 20:25:29.299272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 198/372] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:29 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:29.365548 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.373171 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-afdb7b2c-545d-42cb-b48d-6f5012f5703e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.148581 May 23 20:25:29.373750 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 175/373] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:29 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:29.564015 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:29.564544 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:29.570765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.571208 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.571967 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.572398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.700885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.709127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cddc72c1-2cb8-4762-b039-21236f175f7e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1367 microversion: 2.1 time: 0.148991 May 23 20:25:29.709680 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 199/374] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:29 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:29.734312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:29.734915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:29.741260 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.741700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.742478 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:29.742913 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:29.869467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:29.877423 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c0514416-448b-4b49-95d4-ebeafd4f72a5 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.146930 May 23 20:25:29.877976 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 176/375] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:29 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:30.017878 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:30.018540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:30.025198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.025645 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.026439 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.026864 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.065711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:30.066471 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:30.079762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.079762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.079762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.079762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.111422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:30.122781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-52bb2e74-f869-4cd0-a065-b30e7d45bc26 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1267 microversion: 2.1 time: 0.108119 May 23 20:25:30.132816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 200/376] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:30 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:30.317932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:30.318658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:30.318914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:30.325187 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.325187 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.337239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.337239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.337462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a114d586-186b-4e23-85ca-77142ad4dad3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1278 microversion: 2.1 time: 0.266704 May 23 20:25:30.337462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 177/377] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:30 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:30.389837 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:30.390472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:30.396544 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.396991 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.397777 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.398247 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.464326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:30.475402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:30.476908 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:30.478103 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5db9eb6a-3b1a-4ce0-8e62-1fadfa6a380c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1744 microversion: 2.20 time: 0.164616 May 23 20:25:30.478654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 201/378] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:30 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:30.622364 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:30.630196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-85d9537b-4917-4601-ab67-6f3c216ffa29 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.244137 May 23 20:25:30.630765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 178/379] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:30 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:30.725912 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:30.726572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:30.733454 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.733959 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.734892 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.735326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.889972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:30.899211 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:30.900675 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:30.910560 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.911334 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.912330 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.912954 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.913657 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3a61505a-6d86-468b-a9bb-4ed5fda48e5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1558 microversion: 2.1 time: 0.191561 May 23 20:25:30.916582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 202/380] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:30 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1558 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:30.937313 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d306fca8-36b6-4dd1-abc2-c23de549afff tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:30.937836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d306fca8-36b6-4dd1-abc2-c23de549afff tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:30.946435 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d306fca8-36b6-4dd1-abc2-c23de549afff tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.947023 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d306fca8-36b6-4dd1-abc2-c23de549afff tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:30.947896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d306fca8-36b6-4dd1-abc2-c23de549afff tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:30.948570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d306fca8-36b6-4dd1-abc2-c23de549afff tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.032851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d306fca8-36b6-4dd1-abc2-c23de549afff tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104131 May 23 20:25:31.033804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 203/381] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:25:30 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:25:31.104535 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-d3ad8efa-724c-47f6-a535-6251e88dc9f0 req-f5859212-58a2-49c4-b891-8aa6c276f59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee0bc7f-636f-4b77-bbf0-90e168f07e57", "tag": "900b532d-cbf1-4f24-96e1-9501a7768ef8"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:31.117260 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-d3ad8efa-724c-47f6-a535-6251e88dc9f0 req-f5859212-58a2-49c4-b891-8aa6c276f59a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.118422 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-d3ad8efa-724c-47f6-a535-6251e88dc9f0 req-f5859212-58a2-49c4-b891-8aa6c276f59a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.134143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-d3ad8efa-724c-47f6-a535-6251e88dc9f0 req-f5859212-58a2-49c4-b891-8aa6c276f59a service nova] Creating event network-changed:900b532d-cbf1-4f24-96e1-9501a7768ef8 for instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 on hv-cinder-84301 May 23 20:25:31.142924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:31.150329 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-d3ad8efa-724c-47f6-a535-6251e88dc9f0 req-f5859212-58a2-49c4-b891-8aa6c276f59a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041349 May 23 20:25:31.152140 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 204/382] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:31.155917 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-75cf734b-3a0c-4917-b69e-7ce787e636a6 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.263574 May 23 20:25:31.156785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 179/383] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:30 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:31.160890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:31.161607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:31.168381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.168833 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.169614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.170078 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.260239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:31.268571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-195f17f6-37d7-4405-a138-e53788c71b6e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1275 microversion: 2.1 time: 0.115047 May 23 20:25:31.277869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 205/384] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:31 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1275 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:31.345593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:31.346290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:31.356739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.357503 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.358362 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.358807 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.497950 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:31.499726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:31.508474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.509147 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.510133 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.510747 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.528289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:31.532445 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:31.537405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e96094fe-ae11-4972-8904-989f67bb7cf2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1278 microversion: 2.1 time: 0.196077 May 23 20:25:31.538417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 180/385] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:31 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:31.648190 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:31.648797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:31.660375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.661790 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.662830 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:31.663291 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:31.805692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:31.814755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0532d54f-2b36-496c-a93b-34c488b54cfe tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.170338 May 23 20:25:31.815720 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 181/386] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:31 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:32.043010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:32.052461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:32.054083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:32.055247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2ca99e3f-7d56-4bbe-9d75-24f0ac329dc9 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.562103 May 23 20:25:32.055789 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 206/387] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:31 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:32.173725 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:32.174358 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:32.183570 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.184011 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.184773 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.185201 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.286167 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:32.286856 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:32.288960 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=12 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:32.294150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.294842 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.295710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.297759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.338908 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:32.347063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-675cc409-6b9e-4b8b-ae5a-8796705d5143 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1259 microversion: 2.1 time: 0.178192 May 23 20:25:32.347855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 182/388] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:32 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:32.378951 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:32.386441 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ddd61f2f-f7ed-439d-a5da-affc8ba2ecd6 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1273 microversion: 2.1 time: 0.104990 May 23 20:25:32.387007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 207/389] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:32 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:32.555510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:32.556114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:32.562404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.562850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.563612 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.564048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.706673 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:32.714955 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-00cd3517-188d-4f62-afdf-16fe5ee4670e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1278 microversion: 2.1 time: 0.163429 May 23 20:25:32.715519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 183/390] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:32 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:32.785843 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-75f7ae08-e019-4d81-b460-a8b06338e3b7 req-cfbb4536-75d5-4d5e-8a7f-f25a995a81b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c2e8cd-3178-4528-b5b1-db0638467714", "tag": "ef2feccf-3cf9-483a-be18-bb3f720aec9c"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:32.793992 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-75f7ae08-e019-4d81-b460-a8b06338e3b7 req-cfbb4536-75d5-4d5e-8a7f-f25a995a81b6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.794464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-75f7ae08-e019-4d81-b460-a8b06338e3b7 req-cfbb4536-75d5-4d5e-8a7f-f25a995a81b6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.807303 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-75f7ae08-e019-4d81-b460-a8b06338e3b7 req-cfbb4536-75d5-4d5e-8a7f-f25a995a81b6 service nova] Creating event network-changed:ef2feccf-3cf9-483a-be18-bb3f720aec9c for instance 51c2e8cd-3178-4528-b5b1-db0638467714 on hv-cinder-84301 May 23 20:25:32.814517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-75f7ae08-e019-4d81-b460-a8b06338e3b7 req-cfbb4536-75d5-4d5e-8a7f-f25a995a81b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032651 May 23 20:25:32.815370 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 208/391] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:32.836435 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:32.838288 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:32.850439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:32.853010 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.854540 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.855769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:32.860074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:32.965993 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=4 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:33.074150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:33.074975 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:33.088701 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.089149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.092158 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.092158 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.102217 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:33.111517 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bdf3e37e-62f6-4df1-a463-dda54b74aceb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1501 microversion: 2.1 time: 0.282091 May 23 20:25:33.127247 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 184/392] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:32 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:33.132952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fd72aef-ff9e-40c8-97fa-697ebe2fdf6a"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:33.134440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:33.147046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.147484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.148260 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.148692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.204427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] HTTP exception thrown: Cannot 'attach_volume' instance 4058a126-dae4-43c7-8270-12ea57ea38c6 while it is in vm_state rescued May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Request method failure captured: May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: POST /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6/os-volume_attachments HTTP/1.1 May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 74 May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-060eSaldOSLPXRVhNUGhvociZGC633JEFPxVVHDtDuTPKx4PMyR1lIM71oxfnHfneq-9jWF2_d1xuS-KO1638uBEGF8IK556x2rqNWNBql86zLjbH3Fh-HCnDw4VyLmnV4oDUnZl2OAfUpH2YPeb_3IpsvknLOlDpldliwLOEWJG8 May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:25:33.206902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02969314f19c4dc182b0dbe76aad9a34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}] May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: feb66e681a894c148e3463ff5a0dd1be May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {"volumeAttachment": {"volumeId": "9fd72aef-ff9e-40c8-97fa-697ebe2fdf6a"}} May 23 20:25:33.208199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Cannot 'attach_volume' instance 4058a126-dae4-43c7-8270-12ea57ea38c6 while it is in vm_state rescued May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'server_id': '4058a126-dae4-43c7-8270-12ea57ea38c6', 'body': {'volumeAttachment': {'volumeId': '9fd72aef-ff9e-40c8-97fa-697ebe2fdf6a'}}} May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4058a126-dae4-43c7-8270-12ea57ea38c6 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:25:33.208952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4058a126-dae4-43c7-8270-12ea57ea38c6 while it is in vm_state rescued May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:25:33.210339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:25:33.211710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:25:33.211710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:25:33.211710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4058a126-dae4-43c7-8270-12ea57ea38c6 while it is in vm_state rescued May 23 20:25:33.211710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:25:33.212749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Returning 409 to user: Cannot 'attach_volume' instance 4058a126-dae4-43c7-8270-12ea57ea38c6 while it is in vm_state rescued {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:25:33.213816 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-70f69cc7-1fb0-428d-9e4f-46faeec0c5c6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.085562 May 23 20:25:33.214894 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 185/393] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:25:33 2022] POST /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6/os-volume_attachments => generated 152 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 20:25:33.228336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e1fdd84f-1816-40ec-9ef6-4ea752e01610 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:33.232559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e1fdd84f-1816-40ec-9ef6-4ea752e01610 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:33.232559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=14 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:33.236424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1fdd84f-1816-40ec-9ef6-4ea752e01610 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.236874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1fdd84f-1816-40ec-9ef6-4ea752e01610 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.237681 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1fdd84f-1816-40ec-9ef6-4ea752e01610 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.238147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1fdd84f-1816-40ec-9ef6-4ea752e01610 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.270882 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:33.354097 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:33.380893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:33.387750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:33.389399 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5d580ac9-defb-40f5-9b7d-dadd1a3fd1c8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.319224 May 23 20:25:33.393299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 209/394] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:33 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:33.406615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:33.408548 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:33.429545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.432194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.435229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.437461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.508802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e1fdd84f-1816-40ec-9ef6-4ea752e01610 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6/action" status: 202 len: 0 microversion: 2.1 time: 0.284945 May 23 20:25:33.509884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 186/395] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:25:33 2022] POST /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 20:25:33.517231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:33.518230 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:33.526354 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.527697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.528844 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.529500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.638494 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:33.646393 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d11776a8-2c50-4e93-be75-3141df3a4386 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1273 microversion: 2.1 time: 0.135107 May 23 20:25:33.647798 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 187/396] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:33 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:33.664553 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:33.791971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:33.791971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.791971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.791971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:33.793184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:33.967100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:33.978710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-989f9413-30db-4d6b-aa3c-41db6789950c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1443 microversion: 2.1 time: 0.583817 May 23 20:25:33.990196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 210/397] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:33 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1443 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:34.010243 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:34.010243 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:34.019434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.019890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.020662 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.021316 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.021925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:34.036451 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-98fbfe26-3a7d-40b7-b244-754c13e1d1ce tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1509 microversion: 2.1 time: 0.387717 May 23 20:25:34.046799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 188/398] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:33 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1509 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:34.046799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:34.046799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:34.051936 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.052462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.053739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.054261 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.373920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:34.394529 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-efe914b0-1263-4109-91b9-b6a4d08cacb1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1443 microversion: 2.1 time: 0.344030 May 23 20:25:34.395491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 189/399] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:34 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1443 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:34.410453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:34.411394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:34.425439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.426242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.427213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.427830 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.494767 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:34.507485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b4c9e978-25ce-4f6c-a4b6-2404e3cf9ec8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.511738 May 23 20:25:34.517067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 211/400] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:33 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:34.677983 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:34.679077 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:34.694470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.695211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.697220 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:34.700089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:34.944124 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:34.952711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:34.957610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:34.963366 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5e385e88-c384-4e6c-a5e3-cc5369ce73d5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.559516 May 23 20:25:34.964418 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 190/401] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:34 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:34.998954 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:35.007473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8fd6d711-eb30-4b2e-bdd8-d41f283a2803 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1273 microversion: 2.1 time: 0.346644 May 23 20:25:35.008038 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 212/402] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:34 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1273 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:35.055810 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:35.056577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:35.068727 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:35.070100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:35.071777 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:35.072591 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:35.355576 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:35.364030 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-085de75a-2a13-4d42-84b5-44955b1c2ad7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1509 microversion: 2.1 time: 0.312016 May 23 20:25:35.379732 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 191/403] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:35 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:35.526684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:35.526684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:35.536979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:35.540010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:35.540841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:35.550414 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:35.811588 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:35.831330 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-871b61f4-99d8-45d0-a164-0061ef9bdb9a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.309032 May 23 20:25:35.834526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 213/404] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:35 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:35.983734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:35.984518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:35.994718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:35.997795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:35.999416 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.002657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.024302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:36.025073 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:36.037996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:36.040010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.040657 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.041695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.042365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.276527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:36.286474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e186f98a-8ce4-4fa6-a0da-d95e247a4284 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.263928 May 23 20:25:36.297062 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 214/405] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:36 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:36.299713 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:36.309712 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:36.311621 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:36.313322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2d8c7e39-d1f5-4535-b12b-c2811f3e8a43 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.334557 May 23 20:25:36.314307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 192/406] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:35 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:36.393060 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:36.393060 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:36.397930 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.399586 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.400501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.401048 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.729738 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:36.738473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7b000d09-506a-4b49-8a59-363bf70f675f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1509 microversion: 2.1 time: 0.356375 May 23 20:25:36.742271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 215/407] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:36 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1509 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:36.848161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:36.848774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:36.856808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.857269 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.858669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.859110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.879183 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-bc641881-fa09-43ee-b4c9-669325a8891e req-d2d3474a-551a-48fe-8333-cb3a79831825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201dc4eb-d00c-4410-b7bd-725fc95860d1", "tag": "eb4b6390-9725-4fae-a1c8-9cdc46bac2cb"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:36.897950 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-bc641881-fa09-43ee-b4c9-669325a8891e req-d2d3474a-551a-48fe-8333-cb3a79831825 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:36.902791 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-bc641881-fa09-43ee-b4c9-669325a8891e req-d2d3474a-551a-48fe-8333-cb3a79831825 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:36.943216 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-bc641881-fa09-43ee-b4c9-669325a8891e req-d2d3474a-551a-48fe-8333-cb3a79831825 service nova] Creating event network-changed:eb4b6390-9725-4fae-a1c8-9cdc46bac2cb for instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 on hv-cinder-84301 May 23 20:25:36.956508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-bc641881-fa09-43ee-b4c9-669325a8891e req-d2d3474a-551a-48fe-8333-cb3a79831825 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080782 May 23 20:25:36.957684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 216/408] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:25:37.121387 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:37.132128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bcf79763-c51a-4f85-b6e1-da804e7e257f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.287716 May 23 20:25:37.132712 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 193/409] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:36 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:37.304715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:37.305412 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:37.313747 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:37.314614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:37.315626 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:37.316300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:37.334482 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:37.335170 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:37.343644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:37.347686 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:37.353670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:37.354464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:37.601118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:37.611174 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c1fa99e0-ebec-4a69-bcef-6d687158fd27 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.310511 May 23 20:25:37.620958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 217/410] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:37 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:37.628579 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:37.656074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:37.661193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:37.664440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4a744ad2-9cf8-43f4-b4ce-ca14d5f600ad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.333965 May 23 20:25:37.667063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 194/411] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:37 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:37.756372 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:37.756954 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:37.763377 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:37.764586 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:37.765540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:37.766183 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:37.928686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:37.942007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3b0456df-dc5e-4ac6-9cd5-36a3589842a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1509 microversion: 2.1 time: 0.189573 May 23 20:25:37.943112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 218/412] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:37 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:38.149444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:38.158636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:38.179846 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.186799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.187905 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.188505 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.518683 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-9a00d328-aecc-49fe-986d-c6c93a6dd125 req-805da13d-7f5a-492f-8968-c09d9d584523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18", "tag": "e3fbb816-fd5a-4989-8f75-4be912227768"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:38.520979 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:38.533504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2718a5b8-234c-4e5c-a022-151cc068c3a9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.387116 May 23 20:25:38.534186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 195/413] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:38 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:38.544524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-9a00d328-aecc-49fe-986d-c6c93a6dd125 req-805da13d-7f5a-492f-8968-c09d9d584523 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.546619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-9a00d328-aecc-49fe-986d-c6c93a6dd125 req-805da13d-7f5a-492f-8968-c09d9d584523 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.560638 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-9a00d328-aecc-49fe-986d-c6c93a6dd125 req-805da13d-7f5a-492f-8968-c09d9d584523 service nova] Creating event network-changed:e3fbb816-fd5a-4989-8f75-4be912227768 for instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 on hv-cinder-84301 May 23 20:25:38.568051 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-9a00d328-aecc-49fe-986d-c6c93a6dd125 req-805da13d-7f5a-492f-8968-c09d9d584523 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053875 May 23 20:25:38.573419 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 219/414] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:38.628533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:38.629472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:38.636370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.640370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.640370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.640370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.685730 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:38.686943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:38.699986 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.700728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.701716 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.703569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.834281 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:38.842630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6b1c0fe8-3aac-434c-a4d1-c55bedbe078e tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.217467 May 23 20:25:38.843210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 196/415] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:38 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:38.963453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:38.964481 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:38.972755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.973198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:38.980816 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:38.981284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:39.055995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:39.070981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:39.072516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:39.073713 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-12dd1bf1-25f8-48bd-b9d4-28766da3db51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.393116 May 23 20:25:39.074305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 220/416] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:38 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:39.283553 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:39.291791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ae102804-efdf-47bc-922c-7ed51f3ec0ee tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1515 microversion: 2.1 time: 0.334786 May 23 20:25:39.292373 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 197/417] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:38 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:39.550462 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:39.551323 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:39.558278 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:39.558922 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:39.564655 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:39.564655 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:39.798697 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:39.808150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-911389ea-612e-4db3-8054-fc07ed617af2 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.261711 May 23 20:25:39.810493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 221/418] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:39 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:39.860592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:39.861196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:39.869100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:39.869554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:39.870657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:39.871108 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:40.042166 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:40.054762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-491724b7-2d06-453a-b18c-4fa3be6c6bea tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.196191 May 23 20:25:40.055505 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 198/419] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:39 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:40.101813 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:40.102522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:40.113909 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:40.115746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:40.116575 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:40.117525 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:40.286949 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:40.298491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:40.298491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:40.300016 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ffa073c1-8187-4663-9359-5b1fe1a7c3c1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.201828 May 23 20:25:40.312243 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 222/420] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:40 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:40.824925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:40.825532 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:40.833113 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:40.834005 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:40.835057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:40.835706 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:40.988616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:40.997066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8c959cad-586e-4369-a840-965d46a78ddc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.175958 May 23 20:25:41.008932 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 199/421] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:40 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:41.072579 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:41.073199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:41.081802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:41.084093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:41.084093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:41.084093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:41.176790 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e038f3e6-6b2e-446c-bd0f-d14875e97fe7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'create', calling method: .version_select at 0x7f996d69b040>, body: {"keypair": {"name": "tempest-keypair-641211602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfnskj3gt/gji4s8UA7Xi3zgMvjsxXPr5HvcrJFE3/tJ+yB0zMM9h+HvPaITFmzcsjczW+gIhveOv6hepvK2FGYE8szgboh0S2CerMdCk/woh5G7+2ig44GKItU1Mae6Q=="}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:41.193357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-e038f3e6-6b2e-446c-bd0f-d14875e97fe7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:25:41.198816 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-e038f3e6-6b2e-446c-bd0f-d14875e97fe7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for user feb66e681a894c148e3463ff5a0dd1be and project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:25:41.281714 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:41.296460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-519d658e-cf2a-4aee-bfff-b25dd1f6d469 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.227842 May 23 20:25:41.300029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e038f3e6-6b2e-446c-bd0f-d14875e97fe7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127358 May 23 20:25:41.305630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 200/422] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:25:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:25:41.310341 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 223/423] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:41 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:41.321018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:41.321636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:41.348042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:41.348276 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:41.349017 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:41.349441 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:41.569195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:41.578693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:41.580338 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:41.581599 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-23a3205e-8311-4d01-b78b-7dacbe01557e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.264474 May 23 20:25:41.587396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 201/424] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:41 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:42.019097 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:42.019814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:42.036511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:42.037725 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:42.038754 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:42.039583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:42.254671 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:42.259373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:42.264924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-86e05f0c-a51a-4b21-9c1c-69b490c3535a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.254758 May 23 20:25:42.270976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 224/425] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:42 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:42.322381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:42.326747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:42.336898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:42.337348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:42.339876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:42.339876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:42.557721 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:42.566068 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-25996937-240f-4642-a905-e5095439892d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.253317 May 23 20:25:42.566724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 202/426] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:42 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:42.602067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:42.602853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:42.610323 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:42.610956 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:42.614424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:42.614743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:42.930301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:42.944324 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:42.946427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:42.947880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0144b9c4-5c1f-4a80-89fe-b71082407540 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.351027 May 23 20:25:42.951524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 225/427] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:42 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:43.288951 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:43.289752 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:43.301203 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:43.301796 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:43.302938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:43.303814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:43.332037 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:43.520622 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:43.532193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c56361cc-5127-40c0-875a-66059efb0a9f tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.248080 May 23 20:25:43.541044 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 203/428] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:43 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:43.583398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:43.584252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:43.593792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:43.594609 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:43.595545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:43.596142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:43.831294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:43.853782 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c48b4886-cd9c-40df-a343-cc8f11af5aff tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.274361 May 23 20:25:43.864585 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 226/429] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:43 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:43.967121 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:43.967956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:43.985528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:43.989404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:43.989404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:43.989404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:44.165248 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:44.174718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:44.178306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:44.180689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-600f34ac-3580-42d4-a1f4-7050dbf20ff7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.217681 May 23 20:25:44.181590 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 204/430] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:43 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:44.268557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-829662112", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b05af20-bb00-474e-91be-5942b9baa0f0"}], "security_groups": [{"name": "tempest-securitygroup--416038636"}], "key_name": "tempest-keypair-641211602", "user_data": "}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:44.432257 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] validate_networks() for [('9b05af20-bb00-474e-91be-5942b9baa0f0', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:25:44.553403 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:44.554705 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:44.573966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:44.574765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:44.577901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:44.584821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:44.941292 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:44.954258 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c7984434-887e-4e85-bc54-fe53812d1476 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.405657 May 23 20:25:44.954843 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 205/431] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:44 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:44.960040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:44.960944 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:44.970380 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:44.971103 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:44.972034 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:44.972624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:45.153637 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:45.167878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-95aa8655-b0eb-4e7d-8775-5c512bb8ceab tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.211652 May 23 20:25:45.172308 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 206/432] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:44 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:45.203669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:45.205980 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:45.236848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:45.238496 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:45.240227 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:45.240836 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:45.356617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:25:45.357094 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:25:45.358133 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:25:45.361435 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:25:45.361435 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:25:45.371908 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:45.372353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:45.373733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:45.378723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:45.418557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:25:45.429776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Getting quotas for user feb66e681a894c148e3463ff5a0dd1be and project 02969314f19c4dc182b0dbe76aad9a34. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:25:45.440988 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:45.441982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:25:45.444616 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:25:45.449793 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:45.451161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:45.453663 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f631ebd0-e425-4797-98b2-1c22b44c0a51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.257513 May 23 20:25:45.454270 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 207/433] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:45 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:45.615831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-22b8992a-2a88-49f1-a66e-7faaa85df8e0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.351656 May 23 20:25:45.616821 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 227/434] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:25:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:25:45.628629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1c7688b9-b8de-417b-8d90-5d206edc991a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:45.630738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1c7688b9-b8de-417b-8d90-5d206edc991a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:45.725575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1c7688b9-b8de-417b-8d90-5d206edc991a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:45.734410 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1c7688b9-b8de-417b-8d90-5d206edc991a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1244 microversion: 2.1 time: 0.111354 May 23 20:25:45.735518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 208/435] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:45 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:45.970710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:45.971355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:45.985763 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:45.986245 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:45.987025 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:45.987459 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:46.184630 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:46.192066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:46.193208 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:46.195376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-dd6477d2-d945-4239-9b91-8d12da95cc0b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.228703 May 23 20:25:46.196344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 228/436] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:45 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:46.214386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:46.215126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:46.216250 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:46.217758 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:46.402998 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:46.415274 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8d689104-4720-43f8-83fa-2c0ed4c6b291 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.231215 May 23 20:25:46.416025 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 209/437] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:46 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:46.475089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:46.476444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:46.485358 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:46.486171 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:46.487118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:46.487550 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:46.705679 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:46.714754 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:46.716508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:46.718997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5381bd31-2323-4f8b-86fd-fdf6be7e4923 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.249259 May 23 20:25:46.720052 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 229/438] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:46 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:46.752580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:46.753843 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:46.760596 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:46.761187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:46.762170 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:46.763031 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:46.918206 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:46.925850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d7ab3ff2-5365-4414-8731-47e54494fa4b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1248 microversion: 2.1 time: 0.177674 May 23 20:25:46.926587 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 210/439] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:46 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1248 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:47.125355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-5eae0e8e-7030-483e-a942-dbd76b0f1e3c req-bcb87466-b050-4605-9369-a8f4e56f7a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201dc4eb-d00c-4410-b7bd-725fc95860d1", "name": "network-vif-plugged", "status": "completed", "tag": "eb4b6390-9725-4fae-a1c8-9cdc46bac2cb"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:47.126710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-5eae0e8e-7030-483e-a942-dbd76b0f1e3c req-bcb87466-b050-4605-9369-a8f4e56f7a2e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.127093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-5eae0e8e-7030-483e-a942-dbd76b0f1e3c req-bcb87466-b050-4605-9369-a8f4e56f7a2e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.142291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-5eae0e8e-7030-483e-a942-dbd76b0f1e3c req-bcb87466-b050-4605-9369-a8f4e56f7a2e service nova] Creating event network-vif-plugged:eb4b6390-9725-4fae-a1c8-9cdc46bac2cb for instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 on hv-cinder-84301 May 23 20:25:47.148531 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-5eae0e8e-7030-483e-a942-dbd76b0f1e3c req-bcb87466-b050-4605-9369-a8f4e56f7a2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054176 May 23 20:25:47.149804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 230/440] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:47.213384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:47.214349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:47.221187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.221629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.222470 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.222965 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.364615 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:47.372149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2e19678c-18d0-463e-9a47-7a088b74e21d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.163344 May 23 20:25:47.372700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 211/441] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:47 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:47.433573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:47.434305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:47.441117 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.441559 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.442343 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.445288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.599735 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:47.611874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7d08a9e8-378a-4ef2-9143-5eb210905fe3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.182224 May 23 20:25:47.613191 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 231/442] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:47 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:47.740873 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:47.741482 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:47.748703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.749381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.750346 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.750941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.944451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:47.945208 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:47.952918 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.953497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.954578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:47.955095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:47.962994 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:47.975378 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:47.981029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:47.994591 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d6330ddc-daa3-4947-88f5-b9c72c97a824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.247289 May 23 20:25:47.995443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 212/443] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:47 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:48.079654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:48.088027 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-54135831-27c9-4039-b101-f8a06852734a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1296 microversion: 2.1 time: 0.147910 May 23 20:25:48.091461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 232/444] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:47 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1296 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:48.389703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:48.390711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:48.396994 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:48.397787 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:48.398804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:48.399579 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:48.629172 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:48.630237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:48.638510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:48.639160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:48.640712 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:48.641164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:48.642598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:48.650644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bb6dc7cf-80a2-4fbc-8130-ddd843784d86 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.265430 May 23 20:25:48.660269 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 213/445] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:48 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:48.782565 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:48.790261 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8e6b1942-f1fb-4aaa-8e7c-ca49daa4197d tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1315 microversion: 2.1 time: 0.164918 May 23 20:25:48.790826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 233/446] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:48 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:49.012671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:49.013359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:49.021054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.021054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.021268 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.021627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.104804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:49.105902 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:49.117437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.117890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.118704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.119147 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.197338 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:49.202452 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:49.206562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:49.208426 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:49.209809 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-706bb00d-3607-4086-a8c2-cca7cbac8204 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1739 microversion: 2.20 time: 0.201105 May 23 20:25:49.211845 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0a694d11-f71b-4089-b45b-9fe459d417f9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1314 microversion: 2.1 time: 0.110626 May 23 20:25:49.217705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 234/447] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:49 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1314 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:49.218800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-ff484362-b3ae-485a-a480-c59c42bfd64f req-2e563a04-e462-476b-bb19-89e2af07c93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee0bc7f-636f-4b77-bbf0-90e168f07e57", "name": "network-vif-plugged", "status": "completed", "tag": "900b532d-cbf1-4f24-96e1-9501a7768ef8"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:49.238835 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ff484362-b3ae-485a-a480-c59c42bfd64f req-2e563a04-e462-476b-bb19-89e2af07c93e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.239297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ff484362-b3ae-485a-a480-c59c42bfd64f req-2e563a04-e462-476b-bb19-89e2af07c93e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.245010 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 214/448] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:49 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:49.253127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-ff484362-b3ae-485a-a480-c59c42bfd64f req-2e563a04-e462-476b-bb19-89e2af07c93e service nova] Creating event network-vif-plugged:900b532d-cbf1-4f24-96e1-9501a7768ef8 for instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 on hv-cinder-84301 May 23 20:25:49.258555 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-ff484362-b3ae-485a-a480-c59c42bfd64f req-2e563a04-e462-476b-bb19-89e2af07c93e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044369 May 23 20:25:49.259317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 235/449] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:49.668392 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:49.669087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:49.676258 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.677015 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.679194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.679929 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.808989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:49.810925 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:49.818653 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.819342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.820108 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:49.820934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:49.884355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:49.893200 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d96973d2-c4b7-442d-a039-ac93ea623330 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.229357 May 23 20:25:49.893866 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 215/450] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:49 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:49.978859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:49.986869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-349fdc59-0478-49ea-87d9-dab1f3481b6f tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1465 microversion: 2.1 time: 0.183823 May 23 20:25:49.987436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 236/451] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:49 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:50.034691 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:50.035773 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:50.042461 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.042981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.050457 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.050457 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.070975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:25:50.230557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:50.231185 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:50.241643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.244307 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.245177 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.245628 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.374927 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0bbda316-40e6-4f9c-b761-397a76d9ab2a tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "DELETE /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 204 len: 0 microversion: 2.1 time: 0.342118 May 23 20:25:50.375590 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 216/452] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:25:50 2022] DELETE /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:25:50.383031 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:50.384238 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:50.391674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.392130 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.392418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:50.393126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.393560 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.400112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a3ac396e-a9d2-48ae-ad63-cedeeaeac805 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.173972 May 23 20:25:50.400663 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 237/453] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:50 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:50.405188 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:50.405957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:50.412094 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.412734 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.413643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.414250 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.609957 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:50.619881 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:50.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:50.623369 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-282a66bd-b78f-483a-8fac-c3e9d9d36d40 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1721 microversion: 2.20 time: 0.245377 May 23 20:25:50.623958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 217/454] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:50 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:50.696114 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:50.704509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c4f87160-ee02-4dfd-8112-874455aef29b tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1471 microversion: 2.1 time: 0.302726 May 23 20:25:50.705113 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 238/455] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:50 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:50.913457 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:50.915081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:50.934319 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.934992 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:50.937427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:50.938647 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.113961 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:51.125278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1fbf4441-3bb5-49be-adcf-297b4c31cbaf tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.217806 May 23 20:25:51.127126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 218/456] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:50 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:51.352878 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-632ab3e3-0909-4a62-9145-46262fe34939 req-0e31463e-b0fe-485e-92b1-1513e0966d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ab4da7-dfb5-4755-8ee9-f248b285e751", "tag": "7b51908c-35c3-4298-a108-01fa7493f77c"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:51.362294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-632ab3e3-0909-4a62-9145-46262fe34939 req-0e31463e-b0fe-485e-92b1-1513e0966d98 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:51.362908 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-632ab3e3-0909-4a62-9145-46262fe34939 req-0e31463e-b0fe-485e-92b1-1513e0966d98 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.376081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-632ab3e3-0909-4a62-9145-46262fe34939 req-0e31463e-b0fe-485e-92b1-1513e0966d98 service nova] Creating event network-changed:7b51908c-35c3-4298-a108-01fa7493f77c for instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 on hv-cinder-84301 May 23 20:25:51.384545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-632ab3e3-0909-4a62-9145-46262fe34939 req-0e31463e-b0fe-485e-92b1-1513e0966d98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035632 May 23 20:25:51.385500 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 239/457] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:51.416883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:51.417580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:51.424333 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:51.424854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.425766 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:51.426290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.445146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:51.566145 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:51.573537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-716c5488-cdbd-456c-93c1-71cc547aec58 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.160642 May 23 20:25:51.574283 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 219/458] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:51 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:51.643859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:51.644626 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:51.651693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:51.652226 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.653091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:51.653660 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.721909 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:51.722550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:51.729786 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:51.730263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.731038 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:51.731473 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:51.783635 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:51.791855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:51.793354 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:51.795058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-71eb39b1-268f-4ba7-95ef-d3edee1d3bfe tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1721 microversion: 2.20 time: 0.155059 May 23 20:25:51.795607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 240/459] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:51 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:51.866919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:51.876425 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d814d1c0-386e-4ca0-9197-7f6c9f05a8e7 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1471 microversion: 2.1 time: 0.158432 May 23 20:25:51.876993 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 220/460] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:51 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:52.142858 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:52.143737 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:52.150357 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.150906 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:52.152007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.154382 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:52.289505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:52.297696 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1285a3d9-0e04-4ca8-983f-2fff907e3a64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.159155 May 23 20:25:52.298276 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 241/461] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:52 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:52.591323 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:52.592534 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:52.599867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.600319 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:52.603454 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.603454 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:52.757231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:52.765409 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-88df55b0-b8ea-481d-b738-2ba062a6ec93 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.177914 May 23 20:25:52.765975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 221/462] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:52 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:52.812764 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:52.813296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:52.819768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.820215 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:52.820975 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.821401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:52.896781 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:52.897939 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:52.908150 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.909065 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:52.910107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:52.911562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:53.066250 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:53.069014 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:53.078160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2203c9e0-41cd-4b51-9efb-e7fdce3d9618 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1471 microversion: 2.1 time: 0.188164 May 23 20:25:53.079290 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:53.080085 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:53.081463 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-645fb67f-39d9-42a1-8eeb-bea8f86a32ce tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1721 microversion: 2.20 time: 0.272745 May 23 20:25:53.082756 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 242/463] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:52 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:53.088116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-4bee7a21-ee0b-4923-a498-731586adb797 req-8d89c98e-bf35-4992-98cb-2bfc8a1307c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201dc4eb-d00c-4410-b7bd-725fc95860d1", "name": "network-vif-unplugged", "status": "completed", "tag": "eb4b6390-9725-4fae-a1c8-9cdc46bac2cb"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:53.088557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 222/464] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:52 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:53.097127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-4bee7a21-ee0b-4923-a498-731586adb797 req-8d89c98e-bf35-4992-98cb-2bfc8a1307c2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:53.097558 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-4bee7a21-ee0b-4923-a498-731586adb797 req-8d89c98e-bf35-4992-98cb-2bfc8a1307c2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:53.110169 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-4bee7a21-ee0b-4923-a498-731586adb797 req-8d89c98e-bf35-4992-98cb-2bfc8a1307c2 service nova] Creating event network-vif-unplugged:eb4b6390-9725-4fae-a1c8-9cdc46bac2cb for instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 on hv-cinder-84301 May 23 20:25:53.115214 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-4bee7a21-ee0b-4923-a498-731586adb797 req-8d89c98e-bf35-4992-98cb-2bfc8a1307c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030816 May 23 20:25:53.116095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 243/465] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:53.314791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:53.315641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:53.323721 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:53.324466 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:53.325380 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:53.325925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:53.400666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-99ff70c2-1546-47e9-a06b-e0867dcdaa07 req-d4143c7d-2f46-425c-a285-2c44576e8dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201dc4eb-d00c-4410-b7bd-725fc95860d1", "name": "network-vif-deleted", "tag": "eb4b6390-9725-4fae-a1c8-9cdc46bac2cb"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:53.409382 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-99ff70c2-1546-47e9-a06b-e0867dcdaa07 req-d4143c7d-2f46-425c-a285-2c44576e8dd8 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:53.409869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-99ff70c2-1546-47e9-a06b-e0867dcdaa07 req-d4143c7d-2f46-425c-a285-2c44576e8dd8 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:53.422304 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-99ff70c2-1546-47e9-a06b-e0867dcdaa07 req-d4143c7d-2f46-425c-a285-2c44576e8dd8 service nova] Creating event network-vif-deleted:eb4b6390-9725-4fae-a1c8-9cdc46bac2cb for instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 on hv-cinder-84301 May 23 20:25:53.427895 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-99ff70c2-1546-47e9-a06b-e0867dcdaa07 req-d4143c7d-2f46-425c-a285-2c44576e8dd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031127 May 23 20:25:53.428494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 244/466] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:25:53.480169 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:53.488492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1734067c-4529-460e-8618-b7e104301637 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.178190 May 23 20:25:53.489234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 223/467] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:53 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:53.783178 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:53.783863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:53.790184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:53.790621 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:53.791362 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:53.791790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:53.806920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:53.920863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:53.928235 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c351c333-39f5-4b05-93f4-f13c06843a16 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.149956 May 23 20:25:53.930523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 245/468] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:53 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:54.096349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:54.096994 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:54.099947 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:54.100553 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:54.103589 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.104043 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:54.104804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.105240 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:54.106734 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.107206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:54.107964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.108404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:54.166764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:54.178464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d956d1f1-ff5c-45a5-b8e4-40d980a118a0 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1429 microversion: 2.1 time: 0.086713 May 23 20:25:54.178967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 224/469] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:54 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:54.237792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:54.245742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:54.247271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:54.248443 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-827787ba-96d8-4485-b472-29a5bc2fae62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1721 microversion: 2.20 time: 0.152447 May 23 20:25:54.248989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 246/470] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:54 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:54.509357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:54.509928 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:54.511709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:54.516983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.517423 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:54.518220 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.518654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:54.648737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:54.656185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-91c39751-5350-4a33-93da-23ea28fc38c3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1266 microversion: 2.1 time: 0.150757 May 23 20:25:54.656747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 225/471] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:54 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:54.944696 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:54.945410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:54.952998 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.953437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:54.954230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:54.954657 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.088723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:55.097881 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6fe40530-4633-4491-9de5-ddc18e74d288 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.156888 May 23 20:25:55.098589 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 247/472] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:54 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:55.132793 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-644907fa-93df-4142-b8af-d9098e60ff3f req-74f626ca-78cc-46d4-8dfa-788f5bb46e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d11af6-2834-47d4-92cc-ee3135a9f976", "name": "network-vif-unplugged", "status": "completed", "tag": "f9e2fedd-ed41-4d66-9fcb-34b45c5b6538"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:55.141856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-644907fa-93df-4142-b8af-d9098e60ff3f req-74f626ca-78cc-46d4-8dfa-788f5bb46e07 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.142389 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-644907fa-93df-4142-b8af-d9098e60ff3f req-74f626ca-78cc-46d4-8dfa-788f5bb46e07 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.153634 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-644907fa-93df-4142-b8af-d9098e60ff3f req-74f626ca-78cc-46d4-8dfa-788f5bb46e07 service nova] Creating event network-vif-unplugged:f9e2fedd-ed41-4d66-9fcb-34b45c5b6538 for instance 27d11af6-2834-47d4-92cc-ee3135a9f976 on hv-cinder-84301 May 23 20:25:55.159526 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-644907fa-93df-4142-b8af-d9098e60ff3f req-74f626ca-78cc-46d4-8dfa-788f5bb46e07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030602 May 23 20:25:55.160126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 226/473] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:55.195541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:55.196519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:55.205528 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.205976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.206811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.207244 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.267289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:55.268019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:55.274546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.275001 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.275777 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.276222 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.286078 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:55.293563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8e00997b-9cb4-402d-ad6b-84880684188c tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1300 microversion: 2.1 time: 0.102010 May 23 20:25:55.294292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 248/474] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:55 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:55.411143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:55.420367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:55.422075 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:55.423241 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c23dd1cf-8435-45c8-b876-55d07bdf31f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1721 microversion: 2.20 time: 0.160463 May 23 20:25:55.423799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 227/475] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:55 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:25:55.672578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:55.673236 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:55.675145 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:55.675806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=6 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:55.680646 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.681117 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.681880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.682357 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.815290 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:55.824995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-42cc1939-802e-42e1-b247-7a15105fbb4d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1451 microversion: 2.1 time: 0.156172 May 23 20:25:55.826371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 249/476] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:55 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:55.848665 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:55.849493 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:55.852840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:55.856631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.857669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:55.858925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:55.859353 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.066358 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:56.073855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cdbb38bf-88b2-4f51-ad3c-6087383435b7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1451 microversion: 2.1 time: 0.233438 May 23 20:25:56.074440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 228/477] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:55 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1451 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:56.114770 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:56.115475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:56.121961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.122938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.124130 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.124506 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.265470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:56.273434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-262b9d0c-61d1-4ca1-9b3f-d3bb392376b9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.162382 May 23 20:25:56.274002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 250/478] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:56 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:56.311476 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:56.312218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:56.318946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.323922 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.323922 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.323922 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.353042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.353501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.353953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lazy-loading 'fault' on Instance uuid 201dc4eb-d00c-4410-b7bd-725fc95860d1 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:25:56.402546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:56.409941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-48399bc8-f01d-4e10-b48b-c0bbbce8d3f8 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1305 microversion: 2.1 time: 0.103163 May 23 20:25:56.410535 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 229/479] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:56 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:56.441732 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:56.442379 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:56.448441 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.448886 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.449665 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.450118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.808790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:56.817444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:56.819038 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:56.820220 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-43e41d04-945f-4b9c-ab2d-876c9b231534 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1724 microversion: 2.20 time: 0.382387 May 23 20:25:56.820773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 251/480] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:56 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1724 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:56.839355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-43e1549f-9843-4525-b8a2-2fc5daa5dab1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "780ef178-225c-4829-b784-207e7865dafa"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:56.840575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-43e1549f-9843-4525-b8a2-2fc5daa5dab1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:56.847169 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43e1549f-9843-4525-b8a2-2fc5daa5dab1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.847675 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43e1549f-9843-4525-b8a2-2fc5daa5dab1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:56.848461 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43e1549f-9843-4525-b8a2-2fc5daa5dab1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:56.848888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43e1549f-9843-4525-b8a2-2fc5daa5dab1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:57.290599 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:57.291210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:57.297853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:57.298585 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:57.299427 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:57.299923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:57.428927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:57.437164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-377fb3c7-44cb-41ea-b357-90dbf65505a7 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.150560 May 23 20:25:57.437737 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 252/481] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:57 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:57.446560 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:57.446560 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:57.448687 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:57.449134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:57.449896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:57.450354 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:57.483978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:57.484430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:57.484880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lazy-loading 'fault' on Instance uuid 201dc4eb-d00c-4410-b7bd-725fc95860d1 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:25:57.524707 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b51b4971194a23ab8a16c823843c58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6e338db3274331b7ab0a7370027f24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:57.532131 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2d9e953e-5e0d-4cc9-aeec-b65cedd429a3 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 200 len: 1305 microversion: 2.1 time: 0.093438 May 23 20:25:57.532673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 253/482] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:57 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:25:58.057695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-43e1549f-9843-4525-b8a2-2fc5daa5dab1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.222590 May 23 20:25:58.063605 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 230/483] 10.222.0.16 () {62 vars in 1363 bytes} [Mon May 23 20:25:56 2022] POST /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments => generated 188 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:25:58.182404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-17625eb6-5acc-48a8-8d75-d434261098fc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:58.183186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-17625eb6-5acc-48a8-8d75-d434261098fc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:58.189261 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17625eb6-5acc-48a8-8d75-d434261098fc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.189707 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17625eb6-5acc-48a8-8d75-d434261098fc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.190495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17625eb6-5acc-48a8-8d75-d434261098fc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.190927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17625eb6-5acc-48a8-8d75-d434261098fc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.234480 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:25:58.454613 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:58.455267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:58.476231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.476686 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.477484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.478097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.487452 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-17625eb6-5acc-48a8-8d75-d434261098fc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/action" status: 202 len: 0 microversion: 2.20 time: 0.308858 May 23 20:25:58.491898 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 254/484] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 20:25:58 2022] POST /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 20:25:58.496891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:58.497390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:58.505033 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.505659 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.506803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.507392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.667436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:58.667685 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:58.677823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:58.678633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d087b091-c52c-459d-ac7f-654ceccd26d6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.227856 May 23 20:25:58.680004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:58.681369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4649f655-71d2-4810-add3-d277119c0ed6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1750 microversion: 2.20 time: 0.188330 May 23 20:25:58.682521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 255/485] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:58 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:25:58.687057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 231/486] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:58 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:25:58.687557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:58.688492 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] [instance: 201dc4eb-d00c-4410-b7bd-725fc95860d1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:58.695961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.696199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-311f139f-65ca-4497-ac13-86818ec3b85d req-f68610b3-31e3-4434-a911-ef63ceebe30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee0bc7f-636f-4b77-bbf0-90e168f07e57", "tag": "900b532d-cbf1-4f24-96e1-9501a7768ef8"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:25:58.696615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.697390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.697818 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.706344 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-311f139f-65ca-4497-ac13-86818ec3b85d req-f68610b3-31e3-4434-a911-ef63ceebe30a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:58.706989 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-311f139f-65ca-4497-ac13-86818ec3b85d req-f68610b3-31e3-4434-a911-ef63ceebe30a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:58.714407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] HTTP exception thrown: Instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 could not be found. May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Request method failure captured: May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 HTTP/1.1 May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-2wKkdWwDRWJI0RxWkCMuxK5lBy5CtZ-IgpzdoeGIySNKhZ7uJRuVjoxUugpunDaNmGtyJ4Ub-t152EMhxhoaEI-j66BiZbeaZ5_AWUppJ4oS-q4NWS065sYDIHhI8AMm4tOf5f9gb7gDjDf4KNRj7Xp5c3uaGhxrtQvX3EXUHIDGs May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cd6e338db3274331b7ab0a7370027f24 May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesNegativeTest-393106319 May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:25:58.716934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6e338db3274331b7ab0a7370027f24", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6e338db3274331b7ab0a7370027f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6e338db3274331b7ab0a7370027f24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6e338db3274331b7ab0a7370027f24"}]}] May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesNegativeTest-393106319 May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cd6e338db3274331b7ab0a7370027f24 May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesNegativeTest-393106319 May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesNegativeTest-393106319-project May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: c7b51b4971194a23ab8a16c823843c58 May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesNegativeTest-393106319-project May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 could not be found. May 23 20:25:58.718538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '201dc4eb-d00c-4410-b7bd-725fc95860d1'} May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 could not be found. May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:25:58.719403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 could not be found. May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 could not be found. May 23 20:25:58.720624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:25:58.721800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] Returning 404 to user: Instance 201dc4eb-d00c-4410-b7bd-725fc95860d1 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:25:58.721800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a1cdcfdc-3180-49b4-8528-4e7d61058e54 tempest-VolumesNegativeTest-393106319 tempest-VolumesNegativeTest-393106319-project] 10.222.0.16 "GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1" status: 404 len: 111 microversion: 2.1 time: 0.034806 May 23 20:25:58.721800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 256/487] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:58 2022] GET /compute/v2.1/servers/201dc4eb-d00c-4410-b7bd-725fc95860d1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:25:58.724592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-311f139f-65ca-4497-ac13-86818ec3b85d req-f68610b3-31e3-4434-a911-ef63ceebe30a service nova] Creating event network-changed:900b532d-cbf1-4f24-96e1-9501a7768ef8 for instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 on hv-cinder-84301 May 23 20:25:58.729932 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-311f139f-65ca-4497-ac13-86818ec3b85d req-f68610b3-31e3-4434-a911-ef63ceebe30a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040376 May 23 20:25:58.731298 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 232/488] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:25:59.695725 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:59.696516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:59.701965 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:25:59.703033 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:25:59.713371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:59.719311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:59.719311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:59.719311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:59.729267 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:59.729850 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:59.730800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:25:59.731507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:25:59.975450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:25:59.976352 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:00.007186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:00.007288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-477a9f7d-9cba-4255-88a0-f89cd78e0b25 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.300380 May 23 20:26:00.007288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 257/489] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:25:59 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:00.007439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:00.007439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-99782460-0c52-4b26-ba33-af492a9120f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1750 microversion: 2.20 time: 0.298323 May 23 20:26:00.007439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 233/490] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:25:59 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1750 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:26:01.011302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:01.011909 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:01.013374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:01.014482 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:01.018781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:01.019181 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:01.019932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:01.020574 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:01.021277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:01.021852 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:01.022638 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:01.023316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:01.041046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:01.178186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:01.184808 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:01.192349 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6dab8cbe-036c-4260-91b0-2a4aa9db38f8 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.184989 May 23 20:26:01.193148 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 258/491] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:01 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:01.195694 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:01.197568 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:01.198140 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-714b7c9f-907d-44dc-902b-eef728f68929 req-6a226093-8639-4235-8131-63e19362aeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ab4da7-dfb5-4755-8ee9-f248b285e751", "name": "network-vif-plugged", "status": "completed", "tag": "7b51908c-35c3-4298-a108-01fa7493f77c"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:01.199266 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6b680e82-395f-4c43-8b7f-aab3143ae97e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1752 microversion: 2.20 time: 0.189927 May 23 20:26:01.200285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 234/492] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:01 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1752 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:26:01.209410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-714b7c9f-907d-44dc-902b-eef728f68929 req-6a226093-8639-4235-8131-63e19362aeb3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:01.209831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-714b7c9f-907d-44dc-902b-eef728f68929 req-6a226093-8639-4235-8131-63e19362aeb3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:01.223673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-714b7c9f-907d-44dc-902b-eef728f68929 req-6a226093-8639-4235-8131-63e19362aeb3 service nova] Creating event network-vif-plugged:7b51908c-35c3-4298-a108-01fa7493f77c for instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 on hv-cinder-84301 May 23 20:26:01.228666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-714b7c9f-907d-44dc-902b-eef728f68929 req-6a226093-8639-4235-8131-63e19362aeb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034006 May 23 20:26:01.229538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 259/493] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:02.210184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:02.211426 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:02.217910 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:02.218370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:02.219328 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:02.219771 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:02.222844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:02.224086 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:02.231195 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:02.232159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:02.233127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:02.233563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:02.357647 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:02.365376 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dc1ae27b-36ae-4281-a49d-d337a74a78d0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.159359 May 23 20:26:02.365945 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 235/494] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:02 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:02.369069 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:02.378863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:02.380568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:02.383608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c4b89019-13b6-4f38-8233-f53dab2e5b45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1752 microversion: 2.20 time: 0.163719 May 23 20:26:02.383608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 260/495] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:02 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:26:03.382662 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:03.383311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:03.390353 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:03.390806 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:03.391645 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:03.392105 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:03.400995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:03.402007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:03.408896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:03.409347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:03.410396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:03.417782 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:03.533406 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:03.541185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-21f454d9-e951-4ea6-99a9-70d021b6dc81 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1369 microversion: 2.1 time: 0.162022 May 23 20:26:03.541836 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 236/496] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:03 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1369 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:03.552281 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:03.560944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:03.562995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:03.564151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-fe45ab24-8655-4d1d-8e05-df0edf56c2b7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.167876 May 23 20:26:03.564697 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 261/497] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:03 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:04.557918 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:04.558696 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:04.565131 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:04.565744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:04.567081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:04.567589 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:04.588615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:04.589278 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:04.600040 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:04.602642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:04.604950 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:04.605403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:04.608909 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:04.803512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:04.813181 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:04.814877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:04.816159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-953a068a-e5d8-4daf-9edc-03487c0001c3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.232072 May 23 20:26:04.817265 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 262/498] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:04 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:04.848193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:04.856739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-aaa9b5f3-e810-486a-a8e4-2228ac83e43d tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1563 microversion: 2.1 time: 0.302642 May 23 20:26:04.857300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 237/499] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:04 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1563 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:04.875002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8cc14885-edba-4d19-a376-34bdbff4df10 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:04.875491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8cc14885-edba-4d19-a376-34bdbff4df10 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:04.881689 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8cc14885-edba-4d19-a376-34bdbff4df10 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:04.882165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8cc14885-edba-4d19-a376-34bdbff4df10 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:04.882932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8cc14885-edba-4d19-a376-34bdbff4df10 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:04.883447 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8cc14885-edba-4d19-a376-34bdbff4df10 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:04.973585 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8cc14885-edba-4d19-a376-34bdbff4df10 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102895 May 23 20:26:04.974194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 263/500] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:26:04 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:05.836102 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:05.836971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:05.845184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:05.845631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:05.846716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:05.847155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:06.004514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:06.051671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:06.062349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:06.073947 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3d5cb308-e2ac-4dd3-8a65-986662ed06bb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.232352 May 23 20:26:06.073947 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 238/501] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:05 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:06.229748 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-bc085c9a-3650-4f08-9df7-c645ce22cc11 req-2aaf6d42-4788-4d04-bd60-8fb1ba3c3b98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ab4da7-dfb5-4755-8ee9-f248b285e751", "tag": "7b51908c-35c3-4298-a108-01fa7493f77c"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:06.238277 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-bc085c9a-3650-4f08-9df7-c645ce22cc11 req-2aaf6d42-4788-4d04-bd60-8fb1ba3c3b98 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:06.238718 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-bc085c9a-3650-4f08-9df7-c645ce22cc11 req-2aaf6d42-4788-4d04-bd60-8fb1ba3c3b98 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:06.254463 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-bc085c9a-3650-4f08-9df7-c645ce22cc11 req-2aaf6d42-4788-4d04-bd60-8fb1ba3c3b98 service nova] Creating event network-changed:7b51908c-35c3-4298-a108-01fa7493f77c for instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 on hv-cinder-84301 May 23 20:26:06.256672 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-bc085c9a-3650-4f08-9df7-c645ce22cc11 req-2aaf6d42-4788-4d04-bd60-8fb1ba3c3b98 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031202 May 23 20:26:06.257257 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 264/502] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:07.083485 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:07.084728 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:07.091511 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:07.091963 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:07.093263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:07.093698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:07.251450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:07.270964 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:07.272807 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:07.274242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e174c75a-f388-48d1-907c-87b039a91d3a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.195200 May 23 20:26:07.283689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 239/503] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:07 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:08.293783 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:08.294504 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:08.301296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:08.301747 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:08.302549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:08.302984 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:08.547829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:08.556839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:08.558398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:08.559571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9511a40d-96ca-4e8c-8a6e-befd1a3be3cc tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.270625 May 23 20:26:08.560142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 265/504] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:08 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:09.579544 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:09.581082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:09.588944 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:09.589763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:09.590772 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:09.591430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:09.753493 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:09.762258 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:09.763755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:09.765648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a124acfc-7848-4aa3-9da2-269092748824 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.191257 May 23 20:26:09.766231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 240/505] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:09 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:10.784418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:10.784993 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:10.791724 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:10.792298 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:10.793053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:10.793484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:10.941407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:10.953510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:10.955377 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:10.956783 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cde223f6-061c-49b5-b843-22e57e8385c6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.177102 May 23 20:26:10.957533 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 266/506] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:10 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:11.977215 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:11.981060 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:11.984755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:11.985210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:11.986009 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:11.986547 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:12.135657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:12.146369 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:12.148321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:12.150725 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c3c88afc-16e6-4bc0-9b5d-43f4d94e9014 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.178394 May 23 20:26:12.151856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 241/507] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:11 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:13.170029 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:13.171294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:13.178100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:13.178497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:13.183952 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:13.183952 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:13.356869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:13.366625 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:13.368437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:13.369751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-06d39d1b-81b4-4068-8def-b72524aa922b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.203538 May 23 20:26:13.370284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 267/508] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:13 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:14.387572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:14.388181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:14.395059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:14.395547 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:14.396425 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:14.396876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:14.402344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:14.402344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:14.409091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:14.409768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:14.410769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:14.411546 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:14.536023 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:14.543262 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lazy-loading 'services' on Instance uuid 14f258da-266e-4cb0-8c76-5a3329d1fdc5 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:26:14.544697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:14.546988 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:14.548499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-54242850-b9d7-4aad-8407-93a0679a758c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.164667 May 23 20:26:14.549053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 242/509] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:14 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:14.804549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-42cf9dc2-1257-4d62-90d3-b3655e8b8d0a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-volume_attachments/24976fb0-f43b-4481-b112-975e5c71d5ff" status: 202 len: 0 microversion: 2.1 time: 0.406726 May 23 20:26:14.805205 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 268/510] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:26:14 2022] DELETE /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-volume_attachments/24976fb0-f43b-4481-b112-975e5c71d5ff => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:26:15.568333 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:15.569017 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:15.576206 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:15.578058 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:15.579029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:15.579564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:15.723073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:15.732254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:15.734308 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:15.735601 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7b8ce881-09b6-4ec4-bb8b-cad74cbd2855 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.171774 May 23 20:26:15.736155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 243/511] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:15 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:16.755523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:16.756235 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:16.763166 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:16.763624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:16.764910 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:16.765343 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:16.925485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:16.939720 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:16.941916 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:16.943509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-059af0ef-717a-4cb3-85f8-0887224a183c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.193167 May 23 20:26:16.944365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 269/512] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:16 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:17.963290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:17.964028 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:17.970408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:17.970855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:17.971613 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:17.972048 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:18.099832 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:18.108269 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:18.110290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:18.111475 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f16b7dfd-e954-418b-9e21-da99551930d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.152095 May 23 20:26:18.112268 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 244/513] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:17 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:19.129684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:19.130333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:19.136849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:19.137295 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:19.138075 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:19.138510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:19.266033 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:19.274334 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:19.275820 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:19.276950 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6ea7dabb-6407-4e7d-b915-5b437d9d9b2c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.151483 May 23 20:26:19.277495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 270/514] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:19 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:20.143975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c409bc45-7eac-40f4-a084-706a8f2e19e2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:20.150629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c409bc45-7eac-40f4-a084-706a8f2e19e2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.151097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c409bc45-7eac-40f4-a084-706a8f2e19e2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.174533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c409bc45-7eac-40f4-a084-706a8f2e19e2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Going to try to stop instance {{(pid=118171) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 23 20:26:20.242200 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-03302b42-5f05-4c8a-9775-b19458c2ffca tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:20.242658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-03302b42-5f05-4c8a-9775-b19458c2ffca tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:20.249101 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03302b42-5f05-4c8a-9775-b19458c2ffca tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.249599 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03302b42-5f05-4c8a-9775-b19458c2ffca tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.250379 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03302b42-5f05-4c8a-9775-b19458c2ffca tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.250813 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03302b42-5f05-4c8a-9775-b19458c2ffca tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.274418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-03302b42-5f05-4c8a-9775-b19458c2ffca tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714/ips" status: 200 len: 151 microversion: 2.1 time: 0.036226 May 23 20:26:20.274966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 271/515] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:26:20 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:26:20.285793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b457781-8eca-472a-9ba1-faa63422d026"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:20.286935 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:20.292776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.295526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.295526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.295526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.369627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c409bc45-7eac-40f4-a084-706a8f2e19e2 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action" status: 202 len: 0 microversion: 2.1 time: 0.229450 May 23 20:26:20.370252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 245/516] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:26:20 2022] POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:26:20.378070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Invalid volume: volume 3b457781-8eca-472a-9ba1-faa63422d026 is already attached to instances: 81e99c75-f555-4442-9cb8-9b296d90b049 May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: POST /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714/os-volume_attachments HTTP/1.1 May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 74 May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:26:20.379773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {"volumeAttachment": {"volumeId": "3b457781-8eca-472a-9ba1-faa63422d026"}} May 23 20:26:20.383889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Invalid volume: volume 3b457781-8eca-472a-9ba1-faa63422d026 is already attached to instances: 81e99c75-f555-4442-9cb8-9b296d90b049 May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'server_id': '51c2e8cd-3178-4528-b5b1-db0638467714', 'body': {'volumeAttachment': {'volumeId': '3b457781-8eca-472a-9ba1-faa63422d026'}}} May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3b457781-8eca-472a-9ba1-faa63422d026 is already attached to instances: 81e99c75-f555-4442-9cb8-9b296d90b049 May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:20.384704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3b457781-8eca-472a-9ba1-faa63422d026 is already attached to instances: 81e99c75-f555-4442-9cb8-9b296d90b049 May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:20.386429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:26:20.389066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:26:20.389066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:26:20.389066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:26:20.389066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3b457781-8eca-472a-9ba1-faa63422d026 is already attached to instances: 81e99c75-f555-4442-9cb8-9b296d90b049 May 23 20:26:20.389066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:20.389066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 400 to user: Invalid volume: volume 3b457781-8eca-472a-9ba1-faa63422d026 is already attached to instances: 81e99c75-f555-4442-9cb8-9b296d90b049 {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:26:20.389066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-46edcf08-c80a-4f0d-a1f0-0fc8a254300b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099471 May 23 20:26:20.392920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:20.392920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:20.393096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 272/517] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:26:20 2022] POST /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 23 20:26:20.393096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:20.393096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:20.393348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.393348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.393348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.393348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.396390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.396845 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.397696 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.398147 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.526715 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:20.531115 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:20.537230 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:20.538866 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d0fe9dd1-e08c-4a22-babe-52eb4cf5f973 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.155313 May 23 20:26:20.539334 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:20.540642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2cbb036e-f53b-4387-8461-9e0f44b9a27a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.169267 May 23 20:26:20.541261 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 246/518] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:20 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:20.545966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:20.546716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:20.553508 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.559863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 273/519] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:20 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:20.560018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.560018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.560018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.580863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:26:20.897475 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-73ad3de8-cb12-4121-bc8b-54a820412640 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 204 len: 0 microversion: 2.1 time: 0.354750 May 23 20:26:20.899277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 247/520] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:26:20 2022] DELETE /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:26:20.906322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:20.906937 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:20.913408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.913855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:20.914647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:20.915084 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:21.041307 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:21.049561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2401026b-5914-4a35-9065-4e55ed91b7b0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1683 microversion: 2.1 time: 0.147206 May 23 20:26:21.050131 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 274/521] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:20 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:21.559316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:21.559948 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:21.564833 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:21.565513 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:21.566472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:21.566926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:21.567716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:21.568146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:21.571927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:21.572365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:21.573115 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:21.573541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:21.583332 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:21.701156 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:21.703238 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:21.710676 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7fcdf5a0-49ff-477e-bfd4-775f23281e14 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.149544 May 23 20:26:21.710846 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:21.711231 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 275/522] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:21 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:26:21.715592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:21.715592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ade6947d-86d3-4e7a-96b7-1b7687686e93 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.158727 May 23 20:26:21.715592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 248/523] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:21 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:22.067528 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:22.068137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:22.074118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:22.074566 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:22.075324 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:22.075761 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:22.204362 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:22.211682 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-32e9fbc6-f60f-4f5b-a334-2a7f1ffc0370 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1683 microversion: 2.1 time: 0.148026 May 23 20:26:22.212237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 276/524] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:22 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:22.733884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:22.734519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:22.736690 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:22.737305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:22.741274 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:22.741714 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:22.742516 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:22.742956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:22.744449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:22.744914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:22.745670 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:22.746206 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:22.876314 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:22.884911 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-55ec60bd-c256-47fd-a201-204cbf8105a5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.154819 May 23 20:26:22.885488 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 249/525] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:22 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:22.981104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:22.989581 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:22.991196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:22.992429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-985071e2-7d42-4c32-a78c-d19be0815550 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.259814 May 23 20:26:22.993057 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 277/526] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:22 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:26:23.230086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:23.230704 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:23.237077 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:23.237527 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:23.238328 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:23.238767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:23.365160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:23.372534 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1834fea2-0aca-4905-8024-4e501b6bf523 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1683 microversion: 2.1 time: 0.146397 May 23 20:26:23.373089 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 250/527] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:23 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1683 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:23.903943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:23.904745 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:23.916156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:23.916615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:23.917257 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-0693c1b1-9dd6-4aa3-97ed-ce577c0ef07b req-b03d275f-ff61-4962-b0a8-58198d3bdb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c2e8cd-3178-4528-b5b1-db0638467714", "name": "network-vif-deleted", "tag": "ef2feccf-3cf9-483a-be18-bb3f720aec9c"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:23.917714 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:23.918034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:23.928068 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-0693c1b1-9dd6-4aa3-97ed-ce577c0ef07b req-b03d275f-ff61-4962-b0a8-58198d3bdb86 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:23.928515 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-0693c1b1-9dd6-4aa3-97ed-ce577c0ef07b req-b03d275f-ff61-4962-b0a8-58198d3bdb86 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:23.940603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-0693c1b1-9dd6-4aa3-97ed-ce577c0ef07b req-b03d275f-ff61-4962-b0a8-58198d3bdb86 service nova] Creating event network-vif-deleted:ef2feccf-3cf9-483a-be18-bb3f720aec9c for instance 51c2e8cd-3178-4528-b5b1-db0638467714 on hv-cinder-84301 May 23 20:26:23.947193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-0693c1b1-9dd6-4aa3-97ed-ce577c0ef07b req-b03d275f-ff61-4962-b0a8-58198d3bdb86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033532 May 23 20:26:23.948081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 251/528] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:26:24.013796 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:24.015629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:24.028814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:24.031719 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:24.032955 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:24.033386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:24.082784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:24.091604 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c9e01eee-d839-44ff-a8fb-a687db139fbf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.192618 May 23 20:26:24.091965 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 278/529] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:23 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:24.182095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:24.190812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:24.192299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:24.193453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a88a829d-2a83-4893-83dc-87213d7465f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.185936 May 23 20:26:24.193991 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 252/530] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:24 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:26:24.393488 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:24.394176 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:24.400746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:24.401291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:24.402164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:24.402680 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:24.418211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:24.466541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:24.474277 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a1c7904e-3634-4d9e-b24f-a6ba0b1423bf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1326 microversion: 2.1 time: 0.085334 May 23 20:26:24.474838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 279/531] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:24 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:25.109095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:25.112149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:25.119188 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:25.119729 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:25.120515 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:25.120952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:25.213788 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:25.214328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:25.222322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:25.222985 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:25.223866 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:25.224517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:25.271444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:25.281480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-86a14769-4d38-4bef-8b47-1e646ef657c9 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.177032 May 23 20:26:25.282949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 253/532] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:25 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:25.371803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:25.380396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:25.381890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:25.383106 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c8eb7378-85f5-4366-b537-daac0f1e601c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.174353 May 23 20:26:25.383644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 280/533] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:25 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:25.491171 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:25.491690 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:25.493648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:25.498464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:25.498907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:25.499726 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:25.506093 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:25.531436 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:25.531880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:25.532326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lazy-loading 'fault' on Instance uuid 51c2e8cd-3178-4528-b5b1-db0638467714 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:26:25.571898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:25.579991 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-812ba8d9-5115-487d-a09a-470af20ebac9 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 200 len: 1331 microversion: 2.1 time: 0.092772 May 23 20:26:25.580545 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 254/534] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:25 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:26.299600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:26.300196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:26.306713 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:26.307156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:26.307903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:26.308672 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:26.400479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:26.401092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:26.408602 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:26.409046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:26.409802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:26.410261 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:26.435765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:26.443908 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f635dbab-c424-4c4b-8216-a4363b91abb8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.148779 May 23 20:26:26.444674 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 281/535] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:26 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:26.539258 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:26.547564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:26.549053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:26.550222 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7c4e5ae9-4271-40c7-acda-89e3ed17bd13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.153526 May 23 20:26:26.550825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 255/536] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:26 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:26:26.596839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:26.597545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:26.603595 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:26.604030 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:26.604804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:26.605229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:26.620073 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 HTTP/1.1 May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:26:26.621549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:26:26.623096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '51c2e8cd-3178-4528-b5b1-db0638467714'} May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:26:26.624485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:26:26.625678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:26.626792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:26:26.626792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1eedce30-35d1-4501-8ffc-ea6bf4b3c907 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 404 len: 111 microversion: 2.1 time: 0.030171 May 23 20:26:26.626792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 282/537] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:26 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:26:26.632195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6f76c3fd-a6bb-4ee2-a99e-99491b989c18 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '.version_select at 0x7f996d5cedc0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:26.755105 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6f76c3fd-a6bb-4ee2-a99e-99491b989c18 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122432326" status: 202 len: 0 microversion: 2.1 time: 0.126519 May 23 20:26:26.755605 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 256/538] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 20:26:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2122432326 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:26:27.461044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:27.461653 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:27.468194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.468649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:27.469404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.469839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:27.559480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:27.559940 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:27.567118 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.567566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:27.568325 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.568758 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:27.600889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:27.608337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a0134df6-c147-49b5-8182-53b26248de8a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.151132 May 23 20:26:27.608888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 283/539] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:27 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:27.622384 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:27.622983 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:27.629172 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.629620 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:27.630398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.630833 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:27.696621 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lazy-loading 'services' on Instance uuid 81e99c75-f555-4442-9cb8-9b296d90b049 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:26:27.764062 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:27.774860 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:27.776785 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:27.777946 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-30c2bbb6-188e-48bd-97fb-df77dcdbbdb3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.159152 May 23 20:26:27.778708 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 284/540] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:27 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:27.975659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-50739e43-8ac6-4848-90e1-df914bcc5fdd tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments/3b457781-8eca-472a-9ba1-faa63422d026" status: 202 len: 0 microversion: 2.1 time: 0.420320 May 23 20:26:27.976250 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 257/541] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:26:27 2022] DELETE /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments/3b457781-8eca-472a-9ba1-faa63422d026 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 20:26:27.986656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2c800ba3-ff2c-4a6c-b23b-c79f06cfcbc3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:27.987649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2c800ba3-ff2c-4a6c-b23b-c79f06cfcbc3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:27.994756 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2c800ba3-ff2c-4a6c-b23b-c79f06cfcbc3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.995226 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2c800ba3-ff2c-4a6c-b23b-c79f06cfcbc3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:27.996017 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2c800ba3-ff2c-4a6c-b23b-c79f06cfcbc3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:27.996451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2c800ba3-ff2c-4a6c-b23b-c79f06cfcbc3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:28.025511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2c800ba3-ff2c-4a6c-b23b-c79f06cfcbc3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 May 23 20:26:28.026115 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 285/542] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:26:27 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:28.625920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:28.626646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:28.633317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:28.633763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:28.634546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:28.634976 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:28.767970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:28.775710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f935a254-e2c7-4b0f-aaea-170e1069bee0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.154646 May 23 20:26:28.776271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 258/543] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:28 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:28.796192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:28.796800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:28.799798 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=64 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:28.805189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:28.805189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:28.805713 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:28.806191 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:28.936251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:28.944624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:28.946211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:28.947361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-35fc4c76-6639-4191-a928-453e8d126222 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.155152 May 23 20:26:28.947915 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 286/544] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:28 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:29.037533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6683a2ba-165b-408e-b08b-d45824d964cc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:29.038560 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6683a2ba-165b-408e-b08b-d45824d964cc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:29.044785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6683a2ba-165b-408e-b08b-d45824d964cc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:29.045238 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6683a2ba-165b-408e-b08b-d45824d964cc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:29.046217 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6683a2ba-165b-408e-b08b-d45824d964cc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:29.046484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6683a2ba-165b-408e-b08b-d45824d964cc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:29.077228 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6683a2ba-165b-408e-b08b-d45824d964cc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043568 May 23 20:26:29.077805 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 259/545] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:26:29 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:29.295331 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-b01b7ccb-f209-49c6-bb0b-816a3a22cad8 req-8ff59582-ba7e-48e2-bbf2-97bfe6a20bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d11af6-2834-47d4-92cc-ee3135a9f976", "name": "network-vif-plugged", "status": "completed", "tag": "f9e2fedd-ed41-4d66-9fcb-34b45c5b6538"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:29.303322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-b01b7ccb-f209-49c6-bb0b-816a3a22cad8 req-8ff59582-ba7e-48e2-bbf2-97bfe6a20bb2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:29.303760 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-b01b7ccb-f209-49c6-bb0b-816a3a22cad8 req-8ff59582-ba7e-48e2-bbf2-97bfe6a20bb2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:29.314401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-b01b7ccb-f209-49c6-bb0b-816a3a22cad8 req-8ff59582-ba7e-48e2-bbf2-97bfe6a20bb2 service nova] Creating event network-vif-plugged:f9e2fedd-ed41-4d66-9fcb-34b45c5b6538 for instance 27d11af6-2834-47d4-92cc-ee3135a9f976 on hv-cinder-84301 May 23 20:26:29.319369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-b01b7ccb-f209-49c6-bb0b-816a3a22cad8 req-8ff59582-ba7e-48e2-bbf2-97bfe6a20bb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027612 May 23 20:26:29.319922 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 287/546] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:29.794186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:29.794816 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:29.801308 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:29.801755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:29.802537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:29.802983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:29.937510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:29.945859 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e5716d87-0b65-48f3-8379-32f0047f18db tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.155884 May 23 20:26:29.950668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 260/547] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:29 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:29.965712 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:29.966478 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:29.972660 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:29.973104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:29.973851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:29.974306 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.088745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-67640f86-7984-4c7d-b415-79f70df6125b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:30.089696 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-67640f86-7984-4c7d-b415-79f70df6125b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:30.095724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-67640f86-7984-4c7d-b415-79f70df6125b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.096173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-67640f86-7984-4c7d-b415-79f70df6125b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.096933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-67640f86-7984-4c7d-b415-79f70df6125b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.097383 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-67640f86-7984-4c7d-b415-79f70df6125b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.126817 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-67640f86-7984-4c7d-b415-79f70df6125b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041909 May 23 20:26:30.127378 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 261/548] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:26:30 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 23 20:26:30.153233 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:30.161410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:30.162971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:30.164451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-962bec1f-712f-4481-9cfa-b415ea2af976 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.203380 May 23 20:26:30.174045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 288/549] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:29 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:30.194426 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:30.194870 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:30.200951 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.201406 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.202452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.202894 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.227623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:26:30.474307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-eb36e489-4967-430c-92e2-f7a534e92597 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 204 len: 0 microversion: 2.1 time: 0.283326 May 23 20:26:30.474812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 262/550] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:26:30 2022] DELETE /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:26:30.483027 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:30.483708 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:30.491212 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.491654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.492577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.493013 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.618310 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:30.626229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-355a9bfa-f61c-41cf-9269-22b44e4eae49 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1682 microversion: 2.1 time: 0.147093 May 23 20:26:30.626781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 289/551] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:30 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:30.963987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:30.964676 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:30.971119 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.971565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:30.972315 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:30.972740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:31.099142 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:31.106542 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-203ec09e-5def-402e-81ca-168c9ff72b10 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.146771 May 23 20:26:31.107092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 263/552] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:30 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:31.183696 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:31.184296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:31.190788 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:31.191229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:31.191972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:31.192398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:31.318673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:31.327155 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:31.328639 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:31.329773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4ab8efae-c1aa-485c-bd57-e3ac05326f09 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.149944 May 23 20:26:31.330361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 290/553] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:31 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:31.643708 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:31.644316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:31.650317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:31.659244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:31.659244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:31.659244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:31.659244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:31.780230 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:31.788140 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b48974bf-c3e7-4140-b095-fcbe246ec585 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1682 microversion: 2.1 time: 0.148718 May 23 20:26:31.788703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 264/554] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:31 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:32.123964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:32.124576 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:32.130601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:32.131052 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:32.131815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:32.132255 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:32.262425 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:32.270456 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e28f89e9-1060-4c9c-9ead-a3a4b514f85b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1672 microversion: 2.1 time: 0.150301 May 23 20:26:32.271010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 291/555] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:32 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:32.348198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:32.348792 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:32.356009 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:32.356453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:32.357205 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:32.357636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:32.487631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:32.495858 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:32.497341 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:32.498523 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b45f0919-f836-4ca1-99f8-e35475c0ed8a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.154758 May 23 20:26:32.499255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 265/556] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:32 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:32.805491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:32.806041 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:32.812088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:32.813050 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:32.813807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:32.814271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:32.940214 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:32.947753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-58d9ddcb-19e0-42f6-922f-6ddb775db135 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1682 microversion: 2.1 time: 0.146254 May 23 20:26:32.951990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 292/557] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:32 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1682 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:33.287957 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:33.288886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:33.294945 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.295397 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.296159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.296610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.433118 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:33.441030 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0f89f855-e6d7-400e-85fe-7998f8258a76 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1649 microversion: 2.1 time: 0.156924 May 23 20:26:33.441600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 266/558] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:33 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1649 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:33.462004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-105e1d0c-2f0b-46e2-9d48-74073d28c289 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:33.468685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-105e1d0c-2f0b-46e2-9d48-74073d28c289 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.469643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-105e1d0c-2f0b-46e2-9d48-74073d28c289 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.516381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:33.517201 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:33.523359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.529087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.529087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.529087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.532079 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-105e1d0c-2f0b-46e2-9d48-74073d28c289 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Going to try to start instance {{(pid=118170) start /opt/stack/nova/nova/compute/api.py:2730}} May 23 20:26:33.664484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:33.673597 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:33.675129 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:33.676325 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-764da844-2ac9-48e9-a526-57e459dd267a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.163846 May 23 20:26:33.676888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 267/559] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:33 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:26:33.735566 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-105e1d0c-2f0b-46e2-9d48-74073d28c289 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action" status: 202 len: 0 microversion: 2.1 time: 0.277084 May 23 20:26:33.740900 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 293/560] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:26:33 2022] POST /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:26:33.746276 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:33.746902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:33.754093 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.754557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.755336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.755773 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.892504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:33.901754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7825dc6a-3089-4b5e-898c-e2307b1e7aa0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1658 microversion: 2.1 time: 0.159547 May 23 20:26:33.903046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 268/561] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:33 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1658 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:33.968637 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:33.969570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:33.977573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.978279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:33.979255 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:33.979966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:34.022496 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-51825ade-42e8-4b6e-a7e3-3201f9c7d47b req-3d23a0f3-4b68-411b-9b5d-60fe8cb4b7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e99c75-f555-4442-9cb8-9b296d90b049", "name": "network-vif-deleted", "tag": "b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:34.036560 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-51825ade-42e8-4b6e-a7e3-3201f9c7d47b req-3d23a0f3-4b68-411b-9b5d-60fe8cb4b7e5 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:34.037017 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-51825ade-42e8-4b6e-a7e3-3201f9c7d47b req-3d23a0f3-4b68-411b-9b5d-60fe8cb4b7e5 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:34.050450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-51825ade-42e8-4b6e-a7e3-3201f9c7d47b req-3d23a0f3-4b68-411b-9b5d-60fe8cb4b7e5 service nova] Creating event network-vif-deleted:b8e6c93e-c24a-42b7-b2c1-e01bb46dca5e for instance 81e99c75-f555-4442-9cb8-9b296d90b049 on hv-cinder-84301 May 23 20:26:34.056429 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-51825ade-42e8-4b6e-a7e3-3201f9c7d47b req-3d23a0f3-4b68-411b-9b5d-60fe8cb4b7e5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038366 May 23 20:26:34.057272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 269/562] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:26:34.102533 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:34.112717 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9c68a1af-f961-4171-874d-374911f59b16 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1614 microversion: 2.1 time: 0.150860 May 23 20:26:34.122719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 294/563] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:33 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:34.695397 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:34.696137 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:34.703791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:34.704176 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:34.704958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:34.705395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:34.848601 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:34.858583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:34.860196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:34.861387 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8997b34b-b74a-43e7-b132-a6818c63da98 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1808 microversion: 2.20 time: 0.171333 May 23 20:26:34.862251 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 270/564] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:34 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:34.923681 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:34.926890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:34.933613 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:34.934394 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:34.935400 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:34.936046 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:35.084858 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:35.093327 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-01ac876f-36fd-4e09-bcc3-9451a7ed0afd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1658 microversion: 2.1 time: 0.177576 May 23 20:26:35.093799 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 295/565] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:34 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1658 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:35.130149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:35.130763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:35.136868 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:35.138968 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:35.138968 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:35.138968 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:35.169125 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:35.169573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:35.170042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lazy-loading 'fault' on Instance uuid 81e99c75-f555-4442-9cb8-9b296d90b049 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:26:35.211492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:35.219179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c087a0d9-db92-4447-a519-10a9d1117dc1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 200 len: 1332 microversion: 2.1 time: 0.092794 May 23 20:26:35.219752 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 271/566] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:35 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:35.879594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:35.880192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:35.886244 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:35.886688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:35.887476 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:35.887910 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:35.905495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:36.016486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:36.024733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:36.026356 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:36.027508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c7f14faf-5540-4e6a-8147-c6e89be4ef72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1795 microversion: 2.20 time: 0.151799 May 23 20:26:36.028053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 296/567] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:26:35 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:26:36.112720 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:36.113329 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:36.120964 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:36.121424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:36.122224 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:36.122659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:36.236186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:36.236909 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:36.242885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:36.243397 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:36.244150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:36.244577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:36.253171 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:36.257960 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 HTTP/1.1 May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:26:36.259596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:26:36.261080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '81e99c75-f555-4442-9cb8-9b296d90b049'} May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:26:36.261805 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:26:36.263416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:26:36.265054 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:26:36.265144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-48006468-0bc4-4c26-ade6-1ff780a5c9cf tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1662 microversion: 2.1 time: 0.151970 May 23 20:26:36.265233 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-82dd527e-fa83-4b24-ad46-895c0b1f9578 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 404 len: 111 microversion: 2.1 time: 0.028620 May 23 20:26:36.265333 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 272/568] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:36 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:36.265441 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 297/569] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:36 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 20:26:36.269864 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-77a78204-2c65-4816-abe0-f4a3b82988b5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '.version_select at 0x7f996d5770d0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:36.332017 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-77a78204-2c65-4816-abe0-f4a3b82988b5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361845096" status: 202 len: 0 microversion: 2.1 time: 0.066172 May 23 20:26:36.332604 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 273/570] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 20:26:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1361845096 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 23 20:26:37.021212 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3fc23698-7c42-4f77-9249-13e530474850 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: .version_select at 0x7f996ce32700>, body: {"keypair": {"name": "tempest-keypair-1874300486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPabtsYEmILiutl0Umu//E4pBj4HaRPxmWIcNxFkIxhPgZIPCZNoY6FUTTZW4My8Y7ezdp+kTcRHkd+uvEJsbdaQkJECO8P36PrDEFWT3/5DDm4DKLgv3T6wl78xL3GMeg=="}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:37.036099 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-3fc23698-7c42-4f77-9249-13e530474850 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:26:37.039929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-3fc23698-7c42-4f77-9249-13e530474850 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:26:37.097885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3fc23698-7c42-4f77-9249-13e530474850 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080431 May 23 20:26:37.098507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 298/571] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:26:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:39.201221 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1686854948", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e834b06-191b-4f74-93c9-403bb39ced80"}], "security_groups": [{"name": "tempest-securitygroup--106486053"}], "key_name": "tempest-keypair-1874300486", "user_data": "}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:39.300757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] validate_networks() for [('2e834b06-191b-4f74-93c9-403bb39ced80', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:26:39.656500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:26:39.656925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:26:39.657953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:26:39.658412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:26:39.658825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:26:39.667710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:39.668154 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:39.668969 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:39.669402 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:39.686412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:26:39.690398 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:26:39.701396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:26:39.705903 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:26:39.812416 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ee239499-bab0-4f78-a82a-22ebabee8829 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.616013 May 23 20:26:39.813129 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 274/572] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:26:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:26:39.823512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-dada4069-da8e-46b0-9f66-2218d973d9a0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:39.824056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-dada4069-da8e-46b0-9f66-2218d973d9a0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:39.880592 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-dada4069-da8e-46b0-9f66-2218d973d9a0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:39.887268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-dada4069-da8e-46b0-9f66-2218d973d9a0 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1242 microversion: 2.1 time: 0.067677 May 23 20:26:39.887810 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 299/573] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:39 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:40.905224 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:40.905966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:40.912633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:40.913078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:40.913836 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:40.914295 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:40.977673 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:40.988443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7e518214-945d-4a89-86bb-c0d4ad684087 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1238 microversion: 2.1 time: 0.084660 May 23 20:26:40.989041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 275/574] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:40 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:42.004570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:42.005177 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:42.011937 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:42.012381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:42.013284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:42.013716 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:42.079396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:42.087040 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9db1b928-53cd-4a55-b869-d0a31a68fca5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1300 microversion: 2.1 time: 0.086393 May 23 20:26:42.087612 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 300/575] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:41 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:43.106840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:43.107447 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:43.114875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:43.115320 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:43.116089 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:43.116521 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:43.294746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-5aa2d0bd-f616-419c-b158-2b54bf5a4573 req-84d9d5e4-d918-42ea-ad27-05be3b615a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b5ec55-f363-4dd6-9d30-536d50973c81", "tag": "3048d4fa-e347-4602-a678-0793975bd1e1"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:43.304737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:43.305429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-5aa2d0bd-f616-419c-b158-2b54bf5a4573 req-84d9d5e4-d918-42ea-ad27-05be3b615a83 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:43.306119 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-5aa2d0bd-f616-419c-b158-2b54bf5a4573 req-84d9d5e4-d918-42ea-ad27-05be3b615a83 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:43.312285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5d0ca977-08dd-4f4a-91c1-32d47cc339c1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.209304 May 23 20:26:43.313091 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 276/576] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:43 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:43.319827 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-5aa2d0bd-f616-419c-b158-2b54bf5a4573 req-84d9d5e4-d918-42ea-ad27-05be3b615a83 service nova] Creating event network-changed:3048d4fa-e347-4602-a678-0793975bd1e1 for instance c8b5ec55-f363-4dd6-9d30-536d50973c81 on hv-cinder-84301 May 23 20:26:43.325292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-5aa2d0bd-f616-419c-b158-2b54bf5a4573 req-84d9d5e4-d918-42ea-ad27-05be3b615a83 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034730 May 23 20:26:43.325872 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 301/577] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:26:44.329813 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:44.330444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:44.337197 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:44.337650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:44.338446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:44.338874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:44.463233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:44.470497 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-57c426f7-26d1-46f4-979c-61b32ff28411 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.144982 May 23 20:26:44.471159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 277/578] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:44 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:45.489035 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:45.489653 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:45.495869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:45.496304 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:45.497063 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:45.497495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:45.624600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:45.632213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-55721045-c002-49be-9454-abf5dc46d249 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.148609 May 23 20:26:45.632773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 302/579] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:45 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:46.648663 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:46.649305 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:46.663427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:46.663427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:46.663427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:46.663427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:46.786574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:46.794159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-42bd9420-d31f-41e5-adac-7928318717af tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.149274 May 23 20:26:46.794723 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 278/580] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:46 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:47.811831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:47.812439 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:47.819122 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:47.819570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:47.820326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:47.820759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:47.946049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:47.953683 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-58657061-4bc0-425d-b227-b8b8c9d0cbaf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.146500 May 23 20:26:47.954276 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 303/581] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:47 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:48.970926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:48.971533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:48.977658 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:48.978135 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:48.978890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:48.979371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:49.106030 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:49.113620 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a3813c9b-1790-4e94-a0a2-5fd5dbfa8eb3 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.147094 May 23 20:26:49.114396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 279/582] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:48 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:49.310749 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-ccd591bf-754c-4bd6-aca2-73eab8aeb7c0 req-7a1e87a7-29c6-4498-838e-50df9d611e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b5ec55-f363-4dd6-9d30-536d50973c81", "name": "network-vif-plugged", "status": "completed", "tag": "3048d4fa-e347-4602-a678-0793975bd1e1"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:49.320034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ccd591bf-754c-4bd6-aca2-73eab8aeb7c0 req-7a1e87a7-29c6-4498-838e-50df9d611e5a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:49.320471 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ccd591bf-754c-4bd6-aca2-73eab8aeb7c0 req-7a1e87a7-29c6-4498-838e-50df9d611e5a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:49.332318 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-ccd591bf-754c-4bd6-aca2-73eab8aeb7c0 req-7a1e87a7-29c6-4498-838e-50df9d611e5a service nova] Creating event network-vif-plugged:3048d4fa-e347-4602-a678-0793975bd1e1 for instance c8b5ec55-f363-4dd6-9d30-536d50973c81 on hv-cinder-84301 May 23 20:26:49.337475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-ccd591bf-754c-4bd6-aca2-73eab8aeb7c0 req-7a1e87a7-29c6-4498-838e-50df9d611e5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030356 May 23 20:26:49.338475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 304/583] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:50.130574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:50.131233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:50.133201 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:50.133916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:50.139228 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:50.139679 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:50.140463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:50.140895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:50.269520 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:50.277046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6bb72096-c5a3-4863-928e-bfb9243f0c26 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.150381 May 23 20:26:50.277616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 280/584] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:50 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:26:51.294852 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:51.295544 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:51.297517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=6 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:26:51.303098 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:51.306132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:51.306132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:51.306132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:51.435587 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:51.443578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ea949a19-8ec2-42ab-87a9-e044c2472d79 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1367 microversion: 2.1 time: 0.152836 May 23 20:26:51.444128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 305/585] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:51 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:52.460636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:52.461249 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:52.467794 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:52.468247 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:52.469040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:52.469477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:52.594403 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:26:52.601803 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4b45b46f-b227-48f7-9ad6-571c7c99586b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1558 microversion: 2.1 time: 0.145074 May 23 20:26:52.602394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 281/586] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:26:52 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:26:52.618400 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1e60abed-40d0-4d81-a80f-baba609780f7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:26:52.618904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1e60abed-40d0-4d81-a80f-baba609780f7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:26:52.626043 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1e60abed-40d0-4d81-a80f-baba609780f7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:52.626491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1e60abed-40d0-4d81-a80f-baba609780f7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:52.627259 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1e60abed-40d0-4d81-a80f-baba609780f7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:52.627695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1e60abed-40d0-4d81-a80f-baba609780f7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:52.703453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1e60abed-40d0-4d81-a80f-baba609780f7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088953 May 23 20:26:52.704031 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 306/587] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:26:52 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:26:53.885753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-8a058b1d-6a18-4410-9bce-c951d56344e0 req-d1d5f0aa-6735-4fde-8109-0fa50557726f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b5ec55-f363-4dd6-9d30-536d50973c81", "tag": "3048d4fa-e347-4602-a678-0793975bd1e1"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:26:53.894749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-8a058b1d-6a18-4410-9bce-c951d56344e0 req-d1d5f0aa-6735-4fde-8109-0fa50557726f service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:26:53.895186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-8a058b1d-6a18-4410-9bce-c951d56344e0 req-d1d5f0aa-6735-4fde-8109-0fa50557726f service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:26:53.908493 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-8a058b1d-6a18-4410-9bce-c951d56344e0 req-d1d5f0aa-6735-4fde-8109-0fa50557726f service nova] Creating event network-changed:3048d4fa-e347-4602-a678-0793975bd1e1 for instance c8b5ec55-f363-4dd6-9d30-536d50973c81 on hv-cinder-84301 May 23 20:26:53.913633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-8a058b1d-6a18-4410-9bce-c951d56344e0 req-d1d5f0aa-6735-4fde-8109-0fa50557726f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031525 May 23 20:26:53.914444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 282/588] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:01.602913 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4369e1e6-628f-4853-af04-e7a39ca78235 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9958da5d-38f0-4497-b637-fafedda57340"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:01.603910 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4369e1e6-628f-4853-af04-e7a39ca78235 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:01.605780 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:01.610546 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4369e1e6-628f-4853-af04-e7a39ca78235 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:01.617230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4369e1e6-628f-4853-af04-e7a39ca78235 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:01.617230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4369e1e6-628f-4853-af04-e7a39ca78235 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:01.617230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4369e1e6-628f-4853-af04-e7a39ca78235 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:02.288374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4369e1e6-628f-4853-af04-e7a39ca78235 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690192 May 23 20:27:02.289032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 307/589] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:27:01 2022] POST /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:09.772462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:09.773214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=97 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:09.777554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:09.778658 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:09.784675 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:09.785124 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:09.785883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:09.786360 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:09.808820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lazy-loading 'flavor' on Instance uuid 23ab4da7-dfb5-4755-8ee9-f248b285e751 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:27:10.083059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2fc57250-29dc-41a7-b278-387c02f2bb5f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/action" status: 200 len: 32 microversion: 2.1 time: 0.311988 May 23 20:27:10.083679 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 283/590] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:27:09 2022] POST /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/action => generated 32 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:27:10.093712 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:10.094466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:10.101347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:10.101803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:10.102609 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:10.103075 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:10.107213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:10.236815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:10.245442 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-aae74821-6e4b-41ca-8b3b-180b778c4278 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.156409 May 23 20:27:10.246036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 308/591] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:10 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:11.263570 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:11.264265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:11.270794 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:11.271243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:11.271996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:11.272433 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:11.406384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:11.414981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bb62077b-f1e4-4470-bdd0-88a066a10366 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.156055 May 23 20:27:11.415540 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 284/592] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:11 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:12.432261 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:12.432865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:12.439815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:12.440755 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:12.441521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:12.441957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:12.572940 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:12.581525 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-fcb9238a-c52d-4d3c-88c5-34a40d07827a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.153447 May 23 20:27:12.582109 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 309/593] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:12 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:13.599849 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:13.600368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:13.606937 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:13.607386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:13.608142 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:13.608609 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:13.732001 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:13.739816 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9a3fcc0b-d178-4d0f-bde4-61630bcb1d2f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.144490 May 23 20:27:13.740372 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 285/594] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:13 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:14.756703 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:14.757305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:14.763962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:14.764401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:14.765170 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:14.765599 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:14.892790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:14.901274 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3548806b-3813-4e3d-9588-87c73522bc1a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.148562 May 23 20:27:14.901825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 310/595] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:14 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:15.046742 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1eff5fba-9314-4ac9-9d00-f8ce576ed946 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:15.047907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1eff5fba-9314-4ac9-9d00-f8ce576ed946 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:15.054170 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1eff5fba-9314-4ac9-9d00-f8ce576ed946 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.054614 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1eff5fba-9314-4ac9-9d00-f8ce576ed946 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.055364 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1eff5fba-9314-4ac9-9d00-f8ce576ed946 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.055795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1eff5fba-9314-4ac9-9d00-f8ce576ed946 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.084792 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1eff5fba-9314-4ac9-9d00-f8ce576ed946 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042169 May 23 20:27:15.085330 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 286/596] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:27:15 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:27:15.140837 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:15.141368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:15.147896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.148345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.149104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.149539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.173982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:27:15.322391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-408e7a4d-3a73-427c-b469-e2b8c096ef1c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:15.322933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-408e7a4d-3a73-427c-b469-e2b8c096ef1c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:15.329023 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-408e7a4d-3a73-427c-b469-e2b8c096ef1c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.329467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-408e7a4d-3a73-427c-b469-e2b8c096ef1c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.330254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-408e7a4d-3a73-427c-b469-e2b8c096ef1c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.330685 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-408e7a4d-3a73-427c-b469-e2b8c096ef1c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.360891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-408e7a4d-3a73-427c-b469-e2b8c096ef1c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments/780ef178-225c-4829-b784-207e7865dafa" status: 200 len: 194 microversion: 2.20 time: 0.041331 May 23 20:27:15.360891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 287/597] 10.222.0.16 () {60 vars in 1453 bytes} [Mon May 23 20:27:15 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments/780ef178-225c-4829-b784-207e7865dafa => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:27:15.420712 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:15.421654 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:15.427252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.427695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.428442 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.428875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.450571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4cac9b51-c7fb-4b33-93ba-2535f2da73ac tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 204 len: 0 microversion: 2.1 time: 0.313234 May 23 20:27:15.451587 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 311/598] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:27:15 2022] DELETE /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:27:15.461670 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:15.462866 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:15.469143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.469996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.470414 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.470855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.510259 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lazy-loading 'services' on Instance uuid 27d11af6-2834-47d4-92cc-ee3135a9f976 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:27:15.603991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:15.611656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bcac1647-94e8-4a4c-b3a5-9b3931ca5f3f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1668 microversion: 2.1 time: 0.155448 May 23 20:27:15.612643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 312/599] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:15 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:15.678127 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7391b5a7-57d1-49e4-9c9c-d555e76c1a50 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments/780ef178-225c-4829-b784-207e7865dafa" status: 202 len: 0 microversion: 2.20 time: 0.261084 May 23 20:27:15.678708 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 288/600] 10.222.0.16 () {60 vars in 1456 bytes} [Mon May 23 20:27:15 2022] DELETE /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments/780ef178-225c-4829-b784-207e7865dafa => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 23 20:27:15.687203 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-77e6e640-5039-40f1-8fb0-60c98822e578 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:15.688273 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-77e6e640-5039-40f1-8fb0-60c98822e578 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:15.694802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77e6e640-5039-40f1-8fb0-60c98822e578 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.695243 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77e6e640-5039-40f1-8fb0-60c98822e578 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.695991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77e6e640-5039-40f1-8fb0-60c98822e578 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.696418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77e6e640-5039-40f1-8fb0-60c98822e578 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.726488 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-77e6e640-5039-40f1-8fb0-60c98822e578 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043361 May 23 20:27:15.727024 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 313/601] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 20:27:15 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:27:15.919290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:15.919989 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:15.927020 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.927474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:15.928259 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:15.928693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:16.059833 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:16.067806 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c225a225-a518-4d14-8bfd-1175502b2c98 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.152723 May 23 20:27:16.068365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 289/602] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:15 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:16.630059 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:16.630699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:16.637170 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:16.637623 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:16.638412 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:16.638848 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:16.738180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-26929b9d-0716-4a29-a59a-749860c6293b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:16.739305 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-26929b9d-0716-4a29-a59a-749860c6293b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:16.745363 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-26929b9d-0716-4a29-a59a-749860c6293b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:16.745809 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-26929b9d-0716-4a29-a59a-749860c6293b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:16.746605 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-26929b9d-0716-4a29-a59a-749860c6293b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:16.747040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-26929b9d-0716-4a29-a59a-749860c6293b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:16.764917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:16.773196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-47d286f6-c653-44f9-bd9a-0bb2df232324 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1668 microversion: 2.1 time: 0.146995 May 23 20:27:16.773764 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 314/603] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:16 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:16.776839 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-26929b9d-0716-4a29-a59a-749860c6293b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042682 May 23 20:27:16.777382 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 290/604] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 20:27:16 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:27:17.084619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:17.085163 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:17.091409 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:17.091859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:17.092628 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:17.093066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:17.220408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:17.228358 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3de83ae4-c3bb-4580-9092-559f6a19e829 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.147703 May 23 20:27:17.228911 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 315/605] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:17 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:17.789018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f60af43e-a85f-4fcf-84d3-70a1cfb347ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:17.790494 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f60af43e-a85f-4fcf-84d3-70a1cfb347ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:17.790777 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:17.791385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:17.796483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f60af43e-a85f-4fcf-84d3-70a1cfb347ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:17.796931 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f60af43e-a85f-4fcf-84d3-70a1cfb347ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:17.797631 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:17.797753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f60af43e-a85f-4fcf-84d3-70a1cfb347ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:17.798173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f60af43e-a85f-4fcf-84d3-70a1cfb347ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:17.798271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:17.798995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:17.799423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:17.828573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f60af43e-a85f-4fcf-84d3-70a1cfb347ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043652 May 23 20:27:17.829329 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 291/606] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 20:27:17 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:27:17.932240 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:17.939820 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1bd15a20-b10a-4130-9eaa-36e05546fdba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1668 microversion: 2.1 time: 0.152937 May 23 20:27:17.940485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 316/607] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:17 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:18.247225 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:18.248090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:18.255847 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.256401 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.257243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.257757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.438047 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:18.447730 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-29e7ab6a-8054-4589-a5b2-9819ada246a6 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.205442 May 23 20:27:18.448294 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 292/608] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:18 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:18.809727 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-aa5b6bba-1f9e-48a8-81af-e7818363cc4b req-7ee3ab9f-7fc1-4dc3-ba02-4f763354b827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f258da-266e-4cb0-8c76-5a3329d1fdc5", "name": "network-vif-deleted", "tag": "9991b679-f7be-400d-a65d-c38eece74bbe"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:18.816142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-aa5b6bba-1f9e-48a8-81af-e7818363cc4b req-7ee3ab9f-7fc1-4dc3-ba02-4f763354b827 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.816668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-aa5b6bba-1f9e-48a8-81af-e7818363cc4b req-7ee3ab9f-7fc1-4dc3-ba02-4f763354b827 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.830907 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-aa5b6bba-1f9e-48a8-81af-e7818363cc4b req-7ee3ab9f-7fc1-4dc3-ba02-4f763354b827 service nova] Creating event network-vif-deleted:9991b679-f7be-400d-a65d-c38eece74bbe for instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 on hv-cinder-84301 May 23 20:27:18.838543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-aa5b6bba-1f9e-48a8-81af-e7818363cc4b req-7ee3ab9f-7fc1-4dc3-ba02-4f763354b827 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036314 May 23 20:27:18.839464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 317/609] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:18.842897 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-613cdbb1-2cf2-4793-8ea4-05ad46699692 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:18.844019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-613cdbb1-2cf2-4793-8ea4-05ad46699692 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:18.852987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-613cdbb1-2cf2-4793-8ea4-05ad46699692 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.853485 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-613cdbb1-2cf2-4793-8ea4-05ad46699692 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.854878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-613cdbb1-2cf2-4793-8ea4-05ad46699692 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.855474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-613cdbb1-2cf2-4793-8ea4-05ad46699692 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.889430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-613cdbb1-2cf2-4793-8ea4-05ad46699692 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051771 May 23 20:27:18.891540 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 293/610] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 20:27:18 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:18.954994 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:18.955450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:18.957175 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:18.958633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:18.963572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.964545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.965596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.966389 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.975166 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.977149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:18.977957 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:18.978610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:19.008465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:27:19.060413 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:19.068819 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-317e27e4-c886-400b-a509-8f3721e78ebc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1318 microversion: 2.1 time: 0.115436 May 23 20:27:19.072248 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 294/611] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:18 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1318 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:19.325095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b918c67d-4222-4b09-954d-149f1f6c5b53 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 204 len: 0 microversion: 2.20 time: 0.377218 May 23 20:27:19.325959 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 318/612] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 20:27:18 2022] DELETE /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 20:27:19.335042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:19.335582 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:19.341849 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:19.342404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:19.343173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:19.343607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:19.467238 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:19.472138 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:19.476585 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:19.478962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:19.485410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:19.485410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:19.485410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:19.493800 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:19.495353 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:19.496541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-15e5e82d-73d9-4610-b510-92785c0c9baf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.166278 May 23 20:27:19.497284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 295/613] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:19 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:27:19.621189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:19.629436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0afd1340-2893-4146-8248-a172f6eb0b06 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.167338 May 23 20:27:19.630273 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 319/614] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:19 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:20.086446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:20.087049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:20.093622 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:20.094135 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:20.094886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:20.095312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:20.125951 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:20.126426 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:20.126869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lazy-loading 'fault' on Instance uuid 14f258da-266e-4cb0-8c76-5a3329d1fdc5 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:27:20.130293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:20.166966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:20.174144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-27cd9754-6932-448e-872a-8a3be92bfa04 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 200 len: 1323 microversion: 2.1 time: 0.091543 May 23 20:27:20.175188 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 296/615] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:20 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:20.515104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:20.515710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:20.522196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:20.522636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:20.523380 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:20.523813 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:20.646949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:20.647573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:20.652905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:20.654742 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:20.655291 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:20.656122 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:20.656651 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:20.661294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:20.663049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:20.664198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f465fce7-b700-4e7b-8c8c-905c85633308 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.153086 May 23 20:27:20.664746 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 320/616] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:20 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:20.785013 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:20.792853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fa71fc57-71fa-438e-a7a7-446a946ad779 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.149900 May 23 20:27:20.793407 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 297/617] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:20 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:21.192276 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:21.192902 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:21.198995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:21.199439 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:21.200196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:21.200629 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:21.215328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] HTTP exception thrown: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Request method failure captured: May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 HTTP/1.1 May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0qg1Ta5sVwWKUQUvnkPGHyRxqDNvqxOKmXsD2-1-suiVUKkqNd8tDy4suEEUcEt-aBnlojt1Z_bQW1sgSjFLicaZtpz7-8n8g2Sh9CRjAlP74vz4jM2abYXbmAZ2T154mardew7L5BEc8oDy4IJuTXtvitFRZNxCGo-1F5DeKRdVU May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 39849cec37754352a6822cd57277b954 May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:27:21.216979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39849cec37754352a6822cd57277b954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39849cec37754352a6822cd57277b954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}] May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeTestJSON-1499146306 May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 39849cec37754352a6822cd57277b954 May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 0a19c51d287046578e9e4016784dad8f May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:27:21.218393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '14f258da-266e-4cb0-8c76-5a3329d1fdc5'} May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:27:21.219284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:27:21.220877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:21.223374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Returning 404 to user: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:27:21.223374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-49773bb9-623f-48a4-89b7-83773f18c924 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 404 len: 111 microversion: 2.1 time: 0.030501 May 23 20:27:21.223374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 321/618] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:21 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:27:21.228720 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c53610a4-77cc-4ed3-b012-f6b69c41db96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '.version_select at 0x7f996d577040>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:21.309583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c53610a4-77cc-4ed3-b012-f6b69c41db96 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442869" status: 202 len: 0 microversion: 2.1 time: 0.084618 May 23 20:27:21.310380 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 298/619] 10.222.0.16 () {58 vars in 1208 bytes} [Mon May 23 20:27:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442869 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:27:21.683135 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:21.683924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:21.691586 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:21.692184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:21.693723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:21.694294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:21.810995 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:21.812003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:21.819850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:21.820519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:21.821685 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:21.822300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:21.998404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:22.013107 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:22.022275 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:22.026088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:22.026088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bfdb9cba-0c5e-45b7-b7c6-8bb2c458c482 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1723 microversion: 2.20 time: 0.345747 May 23 20:27:22.026088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 322/620] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:21 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1723 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:27:22.040214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:22.060398 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cf13ba44-866f-41c7-8872-c7d4655b3d04 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.242725 May 23 20:27:22.060398 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 299/621] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:21 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:22.264176 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-1739ffca-9631-46f8-8083-a974cc178890 req-2cf50172-be09-4c0e-bff4-d96fb8be7805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d11af6-2834-47d4-92cc-ee3135a9f976", "name": "network-vif-deleted", "tag": "f9e2fedd-ed41-4d66-9fcb-34b45c5b6538"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:22.274858 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-1739ffca-9631-46f8-8083-a974cc178890 req-2cf50172-be09-4c0e-bff4-d96fb8be7805 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:22.275525 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-1739ffca-9631-46f8-8083-a974cc178890 req-2cf50172-be09-4c0e-bff4-d96fb8be7805 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:22.307058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-1739ffca-9631-46f8-8083-a974cc178890 req-2cf50172-be09-4c0e-bff4-d96fb8be7805 service nova] Creating event network-vif-deleted:f9e2fedd-ed41-4d66-9fcb-34b45c5b6538 for instance 27d11af6-2834-47d4-92cc-ee3135a9f976 on hv-cinder-84301 May 23 20:27:22.313447 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-1739ffca-9631-46f8-8083-a974cc178890 req-2cf50172-be09-4c0e-bff4-d96fb8be7805 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053173 May 23 20:27:22.314617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 323/622] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:22.400171 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-45ad7e86-b6d6-4868-8cee-073a73f7f8cb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'create', calling method: .version_select at 0x7f996d5773a0>, body: {"keypair": {"name": "tempest-keypair-1614999825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFefY4TazICKz3SLsz3ovhPq6UODSlA0Ojst81Z7AH6OxzHBUESlDiDZ7+3Gd3QDN/ZV4is0pM6G/H+S2BdazVgWyLl6fenPdDNt7QxMYL8xskRuBkr2syVMBqFJaVbqg=="}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:22.419689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-45ad7e86-b6d6-4868-8cee-073a73f7f8cb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for project 39849cec37754352a6822cd57277b954. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:27:22.427849 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-45ad7e86-b6d6-4868-8cee-073a73f7f8cb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for user 0a19c51d287046578e9e4016784dad8f and project 39849cec37754352a6822cd57277b954. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:27:22.541225 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-45ad7e86-b6d6-4868-8cee-073a73f7f8cb tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.144881 May 23 20:27:22.542390 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 300/623] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:27:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:23.045081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:23.045987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:23.054407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:23.054938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:23.055772 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:23.056238 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:23.068450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:23.069064 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:23.075936 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:23.076792 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:23.077746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:23.078235 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:23.096677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:23.097365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:23.097978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lazy-loading 'fault' on Instance uuid 27d11af6-2834-47d4-92cc-ee3135a9f976 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:27:23.143080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:23.157375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:23.159210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:23.160795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-11419088-9315-48d6-a598-6c3dc1b6fa60 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 200 len: 1371 microversion: 2.20 time: 0.120747 May 23 20:27:23.172554 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 324/624] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:23 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:23.267327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:23.272200 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8b10385e-e0b1-4d44-b510-409b443c903a tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.208275 May 23 20:27:23.275593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 301/625] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:23 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:24.179327 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:24.180027 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:24.187064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:24.187594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:24.188359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:24.188793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:24.202814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] HTTP exception thrown: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Request method failure captured: May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 HTTP/1.1 May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-06NRYKCrvAuSC5fecg2m10JBTSIJG0bBXCNEja1bIajuEq0Eol0UMScEUTATzeEinhib3ZY_BwjCrmAsbwlwN1ANVmRWW5se8PeY0h13-Kb_WRMJK0SOd6OtAi0nSWzia05_-yIyYSfgIhXluqEU1cnfprK3e3KgPqae4JorXbgVk May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Openstack-Nova-Api-Version: 2.20 May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:27:24.204453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a05af8ceb6d041a6a894d5ca3ff820cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}] May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: c4586fdc3e8b4ee0ab58d8c236637a4f May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:27:24.206691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '27d11af6-2834-47d4-92cc-ee3135a9f976'} May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:27:24.207632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:27:24.209914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:24.211247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Returning 404 to user: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:27:24.211247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-21f68d5a-b7ab-45e4-aa46-d8664a9a92ba tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 404 len: 111 microversion: 2.20 time: 0.030474 May 23 20:27:24.211247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 325/626] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:24 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 20:27:24.220196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bbc9cc4f-26d1-483b-9102-6010ed3c78d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '.version_select at 0x7f996d577040>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:24.288956 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:24.289487 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:24.295650 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:24.296776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:24.296900 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:24.297276 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:24.308666 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bbc9cc4f-26d1-483b-9102-6010ed3c78d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-258098076" status: 204 len: 0 microversion: 2.20 time: 0.092285 May 23 20:27:24.309252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 302/627] 10.222.0.16 () {60 vars in 1258 bytes} [Mon May 23 20:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-258098076 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 20:27:24.520387 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:24.529473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6a237ba8-2d17-4c7a-a1da-81dd1247a43b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.243272 May 23 20:27:24.529473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 326/628] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:24 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:24.831970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1739012632", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e4da5b57-d47b-4357-af5e-3630e836e52a"}], "security_groups": [{"name": "tempest-securitygroup--1079561457"}], "key_name": "tempest-keypair-1614999825", "user_data": "}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:24.962073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] validate_networks() for [('e4da5b57-d47b-4357-af5e-3630e836e52a', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:27:25.512237 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:27:25.512828 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:27:25.513233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:27:25.513642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:27:25.514069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:27:25.523410 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:25.523858 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:25.524646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:25.525081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:25.527699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3a901646-5f44-43bc-8c5e-27ecfcb094f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'create', calling method: .version_select at 0x7f996cef68b0>, body: {"keypair": {"name": "tempest-keypair-1382161781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe07AqbD6m9G8E/tZYTvQL7yfhncAYKVmsw0zINgTODgTqErbIhV92OcCZ5lSWXuS4DVtLDb0LQXRYyeO7rECCp3rWzKLIXqhJbgL8fZXrYwm3aqT7KqWDQqpLAABrQTg=="}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:25.542095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for project 39849cec37754352a6822cd57277b954. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:27:25.543343 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-3a901646-5f44-43bc-8c5e-27ecfcb094f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:27:25.546003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Getting quotas for user 0a19c51d287046578e9e4016784dad8f and project 39849cec37754352a6822cd57277b954. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:27:25.547274 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-3a901646-5f44-43bc-8c5e-27ecfcb094f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for user c4586fdc3e8b4ee0ab58d8c236637a4f and project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:27:25.556925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:27:25.559222 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:27:25.709365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3a901646-5f44-43bc-8c5e-27ecfcb094f4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.186024 May 23 20:27:25.710047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 327/629] 10.222.0.16 () {62 vars in 1199 bytes} [Mon May 23 20:27:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 187 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 23 20:27:25.716361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:25.716361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:25.722408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:25.722852 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:25.723606 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:25.724036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:25.745028 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1bb32d7e-0e2e-48b1-8806-052427f70374 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.917667 May 23 20:27:25.746105 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 303/630] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:27:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:27:25.756367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dece5538-49d3-49f7-bc8a-2c2f5aafe036 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:25.757107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-dece5538-49d3-49f7-bc8a-2c2f5aafe036 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:25.824156 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dece5538-49d3-49f7-bc8a-2c2f5aafe036 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:25.832607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dece5538-49d3-49f7-bc8a-2c2f5aafe036 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1238 microversion: 2.1 time: 0.080407 May 23 20:27:25.833610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 304/631] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:25 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:25.898368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:25.906966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-50a105bc-e07e-4778-820d-0156a8f52d77 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.195026 May 23 20:27:25.917509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 328/632] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:25 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:26.849292 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:26.850463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:26.856523 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:26.856970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:26.857740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:26.858220 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:26.924996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:26.925618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:26.932662 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:26.933464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:26.934424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:26.935033 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:26.952473 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:26.961483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-55eeca0c-5fa1-455f-aee7-4d2650b4d403 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1242 microversion: 2.1 time: 0.116566 May 23 20:27:26.962126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 305/633] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:26 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1242 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:27.102087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:27.113151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-38282e14-d4e6-40f3-9c06-694520bb0948 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.192792 May 23 20:27:27.114000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 329/634] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:26 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:27.941569 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-666175998", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8643c6ef-a04e-42d5-acb9-668f5c2b5666"}], "security_groups": [{"name": "tempest-securitygroup--1485599797"}], "key_name": "tempest-keypair-1382161781", "user_data": "}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:27.977900 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:27.978570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:27.985100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:27.985553 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:27.986373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:27.987457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:28.045600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] validate_networks() for [('8643c6ef-a04e-42d5-acb9-668f5c2b5666', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:27:28.049169 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:28.057160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-85f36dbf-93f4-419f-af8d-1f9d6a25b901 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1290 microversion: 2.1 time: 0.083045 May 23 20:27:28.057704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 330/635] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:27 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:28.130806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:28.131406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:28.137320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:28.137767 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:28.138573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:28.139006 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:28.272522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:28.280545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7b1d6a28-5a8e-4f6c-8a19-8945680fd54c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1733 microversion: 2.1 time: 0.153567 May 23 20:27:28.283991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 331/636] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:28 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:28.410711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:27:28.411285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:27:28.411831 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:27:28.412400 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:27:28.412810 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:27:28.421683 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:28.422152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:28.423000 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:28.423432 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:28.439796 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:27:28.443564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Getting quotas for user c4586fdc3e8b4ee0ab58d8c236637a4f and project a05af8ceb6d041a6a894d5ca3ff820cc. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:27:28.454659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:27:28.457354 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:27:28.589386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e42316ee-dc51-4b37-94ec-20373cb29e11 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.652028 May 23 20:27:28.590139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 306/637] 10.222.0.16 () {62 vars in 1187 bytes} [Mon May 23 20:27:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 23 20:27:28.600699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-27456985-47b1-4f46-9ece-63897aa67b13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:28.601299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-27456985-47b1-4f46-9ece-63897aa67b13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:28.654472 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-27456985-47b1-4f46-9ece-63897aa67b13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:28.662317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-27456985-47b1-4f46-9ece-63897aa67b13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:28.663817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-27456985-47b1-4f46-9ece-63897aa67b13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:28.665306 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-27456985-47b1-4f46-9ece-63897aa67b13 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1281 microversion: 2.20 time: 0.068959 May 23 20:27:28.665862 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 332/638] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:28 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:27:29.079878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:29.080502 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:29.084245 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:29.089525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.090623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.090846 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.091283 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.163804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:29.171555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f684047e-66aa-495a-bdd4-33cf3923ebc5 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1298 microversion: 2.1 time: 0.096255 May 23 20:27:29.172608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 307/639] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:29 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:29.300165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:29.301301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:29.308426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.308876 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.309646 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.310155 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.441342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:29.449779 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-190912b4-369b-48b0-b292-a98773f2d83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1713 microversion: 2.1 time: 0.154670 May 23 20:27:29.450396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 333/640] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:29 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:29.553855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:29.554458 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:29.561244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.561769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.562703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.563133 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.657490 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] HTTP exception thrown: Cannot 'detach_volume' instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 while it is in vm_state rescued May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Request method failure captured: May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: DELETE /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments/9958da5d-38f0-4497-b637-fafedda57340 HTTP/1.1 May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-060eSaldOSLPXRVhNUGhvociZGC633JEFPxVVHDtDuTPKx4PMyR1lIM71oxfnHfneq-9jWF2_d1xuS-KO1638uBEGF8IK556x2rqNWNBql86zLjbH3Fh-HCnDw4VyLmnV4oDUnZl2OAfUpH2YPeb_3IpsvknLOlDpldliwLOEWJG8 May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:27:29.659692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02969314f19c4dc182b0dbe76aad9a34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}] May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: feb66e681a894c148e3463ff5a0dd1be May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:27:29.661242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Cannot 'detach_volume' instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 while it is in vm_state rescued May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'server_id': '23ab4da7-dfb5-4755-8ee9-f248b285e751', 'id': '9958da5d-38f0-4497-b637-fafedda57340'} May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:27:29.662042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 while it is in vm_state rescued May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 while it is in vm_state rescued May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:27:29.663254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Returning 409 to user: Cannot 'detach_volume' instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 while it is in vm_state rescued {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:27:29.664345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b95552a7-43f2-4302-8b35-0fc91fd09932 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments/9958da5d-38f0-4497-b637-fafedda57340" status: 409 len: 152 microversion: 2.1 time: 0.111990 May 23 20:27:29.664345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 308/641] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:27:29 2022] DELETE /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments/9958da5d-38f0-4497-b637-fafedda57340 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 23 20:27:29.670685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e5fc7b27-32c6-417e-a991-14d4f814ce12 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:29.671248 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e5fc7b27-32c6-417e-a991-14d4f814ce12 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:29.679193 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e5fc7b27-32c6-417e-a991-14d4f814ce12 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.679649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e5fc7b27-32c6-417e-a991-14d4f814ce12 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.680425 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e5fc7b27-32c6-417e-a991-14d4f814ce12 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.680859 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e5fc7b27-32c6-417e-a991-14d4f814ce12 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.684106 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:29.685875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:29.691525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.692103 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.693184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.693739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.783309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:29.792670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:29.794383 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:29.796175 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0d564382-7e86-419d-9ad1-24eb25d31d1b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1285 microversion: 2.20 time: 0.116862 May 23 20:27:29.796983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 309/642] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:29 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:29.957529 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e5fc7b27-32c6-417e-a991-14d4f814ce12 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "POST /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/action" status: 202 len: 0 microversion: 2.1 time: 0.290589 May 23 20:27:29.958190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 334/643] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:27:29 2022] POST /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:27:29.966630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:29.967243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:29.973923 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.974604 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:29.975370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:29.975972 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:30.192475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:30.193404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:30.197610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:30.203159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:30.203690 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:30.207804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:30.207804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:30.209284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-19e727ca-2997-485e-bf8d-e38a427445f0 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1721 microversion: 2.1 time: 0.246538 May 23 20:27:30.212254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 310/644] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:29 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:30.363381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:30.370740 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8f1ea881-4c89-470e-a4ea-cdbe2dc0fe19 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.184349 May 23 20:27:30.371308 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 335/645] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:30 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:30.698295 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-297a73d6-c422-4e69-9c03-d5fb072e8fc4 req-acd831e4-1472-49c6-b81c-6ae8fec32e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22718422-007c-4e56-a5b2-5154cd7ad3b9", "tag": "9f6f0b95-22e5-471b-aabe-b625aff9995f"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:30.711860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-297a73d6-c422-4e69-9c03-d5fb072e8fc4 req-acd831e4-1472-49c6-b81c-6ae8fec32e01 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:30.712316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-297a73d6-c422-4e69-9c03-d5fb072e8fc4 req-acd831e4-1472-49c6-b81c-6ae8fec32e01 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:30.724745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-297a73d6-c422-4e69-9c03-d5fb072e8fc4 req-acd831e4-1472-49c6-b81c-6ae8fec32e01 service nova] Creating event network-changed:9f6f0b95-22e5-471b-aabe-b625aff9995f for instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 on hv-cinder-84301 May 23 20:27:30.731625 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-297a73d6-c422-4e69-9c03-d5fb072e8fc4 req-acd831e4-1472-49c6-b81c-6ae8fec32e01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036989 May 23 20:27:30.732232 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 311/646] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:30.815649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:30.816323 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:30.823354 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:30.824187 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:30.825243 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:30.826501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:30.932325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:30.951413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:30.954506 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:30.955549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-df4eee04-57ee-4060-bffc-2fa0f46faf45 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1341 microversion: 2.20 time: 0.144456 May 23 20:27:30.956721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 336/647] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:30 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1341 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:31.231013 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:31.231724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:31.238649 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.239164 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:31.240013 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.240518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:31.369145 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:31.377272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f5101686-d3e4-419f-bae8-70eab1f85a79 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1721 microversion: 2.1 time: 0.152209 May 23 20:27:31.377842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 312/648] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:31 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:31.387678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:31.388286 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:31.395266 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.395716 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:31.396480 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.396915 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:31.544781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:31.552496 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bcd7334e-d19d-4b55-bb57-0fa0a7a9994a tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.168671 May 23 20:27:31.553161 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 337/649] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:31 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:31.681911 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-37c75e93-cc2c-4802-a4a2-7d4576cc4822 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:31.682422 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-37c75e93-cc2c-4802-a4a2-7d4576cc4822 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:31.688809 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37c75e93-cc2c-4802-a4a2-7d4576cc4822 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.689259 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37c75e93-cc2c-4802-a4a2-7d4576cc4822 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:31.690575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37c75e93-cc2c-4802-a4a2-7d4576cc4822 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.690999 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37c75e93-cc2c-4802-a4a2-7d4576cc4822 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:31.716843 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-37c75e93-cc2c-4802-a4a2-7d4576cc4822 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/ips" status: 200 len: 150 microversion: 2.1 time: 0.038855 May 23 20:27:31.717586 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 313/650] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:27:31 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:31.973736 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:31.983766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:31.983766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:31.983766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.983766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:31.984166 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:31.984166 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:32.110819 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:32.119247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:32.120748 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:32.121875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b96945d8-52e9-448b-9952-45c46dbf1968 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.152065 May 23 20:27:32.122464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 338/651] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:31 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:32.394074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:32.395551 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:32.402839 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:32.403303 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:32.404131 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:32.404573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:32.570382 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:32.572259 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:32.580572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:32.581517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:32.582727 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:32.583341 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:32.602707 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:32.626406 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e178ce80-122f-43b2-a077-177f2204de6e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1721 microversion: 2.1 time: 0.221830 May 23 20:27:32.630144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 314/652] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:32 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:32.803279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:32.810727 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ff4ab959-e270-4f20-8b18-4dedc48c4427 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.245163 May 23 20:27:32.811278 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 339/653] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:32 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:33.140542 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:33.141232 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:33.148184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.148733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.149716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.150313 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.286821 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-4a9bac21-bdcc-4adf-9b4b-2c55aada040d req-8686e09d-d18a-4089-914c-6709859484e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac", "tag": "d964f307-0816-459b-b91f-c56aa300d183"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:33.300376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-4a9bac21-bdcc-4adf-9b4b-2c55aada040d req-8686e09d-d18a-4089-914c-6709859484e8 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.301020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-4a9bac21-bdcc-4adf-9b4b-2c55aada040d req-8686e09d-d18a-4089-914c-6709859484e8 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.320616 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-4a9bac21-bdcc-4adf-9b4b-2c55aada040d req-8686e09d-d18a-4089-914c-6709859484e8 service nova] Creating event network-changed:d964f307-0816-459b-b91f-c56aa300d183 for instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac on hv-cinder-84301 May 23 20:27:33.331884 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-4a9bac21-bdcc-4adf-9b4b-2c55aada040d req-8686e09d-d18a-4089-914c-6709859484e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048537 May 23 20:27:33.332767 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 340/654] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:33.339726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-74b80c32-63ec-4e3b-85b8-877be34b7971 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bc228bf-b00e-40ad-8052-c4e9a9b2745f"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:33.340970 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-74b80c32-63ec-4e3b-85b8-877be34b7971 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:33.349523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-74b80c32-63ec-4e3b-85b8-877be34b7971 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.349975 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-74b80c32-63ec-4e3b-85b8-877be34b7971 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.350793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-74b80c32-63ec-4e3b-85b8-877be34b7971 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.351420 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-74b80c32-63ec-4e3b-85b8-877be34b7971 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.576241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:33.641941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:33.654338 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:33.654338 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:33.659101 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1b116e02-9701-4145-b0b0-322ff6b3fe80 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.522390 May 23 20:27:33.660100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 315/655] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:33 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:33.665299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:33.666824 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:33.673437 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.674856 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.675840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.676598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.810082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:33.818606 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-72cf54e0-3e14-427f-a9bd-75e5308d65bb tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1727 microversion: 2.1 time: 0.157269 May 23 20:27:33.819482 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 316/656] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:33 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:33.831830 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:33.832450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:33.838347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.838798 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.839566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.840004 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.968804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:33.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0a7eb53f-4e17-47e0-9f76-8cf0e223a30b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.148734 May 23 20:27:33.977463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 317/657] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:33 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:33.982133 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b6aed717-751d-4e3b-b148-9b3ee330c299 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:33.982619 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b6aed717-751d-4e3b-b148-9b3ee330c299 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:33.988773 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6aed717-751d-4e3b-b148-9b3ee330c299 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.989222 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6aed717-751d-4e3b-b148-9b3ee330c299 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:33.990109 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6aed717-751d-4e3b-b148-9b3ee330c299 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:33.990753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b6aed717-751d-4e3b-b148-9b3ee330c299 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:34.066352 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b6aed717-751d-4e3b-b148-9b3ee330c299 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087801 May 23 20:27:34.066936 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 318/658] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:27:33 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:34.157037 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-74b80c32-63ec-4e3b-85b8-877be34b7971 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.822560 May 23 20:27:34.157688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 341/659] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:27:33 2022] POST /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:34.678944 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:34.680556 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:34.688869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:34.690398 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:34.691588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:34.692033 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:34.917108 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:34.920601 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:34.925453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:34.927018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:34.928121 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d4df3e3c-facc-4c46-adbf-aa5438fd4c6c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.254859 May 23 20:27:34.928675 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 319/660] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:34 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:34.994124 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:34.995009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:35.001344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:35.002515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:35.003285 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:35.003718 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:35.141576 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-e85f1336-1bcb-4ffe-95a2-020e9bbe4aa4 req-6119971c-e397-4a62-bb09-ce5817919cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ab4da7-dfb5-4755-8ee9-f248b285e751", "tag": "7b51908c-35c3-4298-a108-01fa7493f77c"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:35.145666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:35.155840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-e85f1336-1bcb-4ffe-95a2-020e9bbe4aa4 req-6119971c-e397-4a62-bb09-ce5817919cd6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:35.156534 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-e85f1336-1bcb-4ffe-95a2-020e9bbe4aa4 req-6119971c-e397-4a62-bb09-ce5817919cd6 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:35.162853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-477ab1ad-b7a1-4c16-b9a0-f14f8832c3ed tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.173711 May 23 20:27:35.163468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 342/661] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:34 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:35.171108 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-e85f1336-1bcb-4ffe-95a2-020e9bbe4aa4 req-6119971c-e397-4a62-bb09-ce5817919cd6 service nova] Creating event network-changed:7b51908c-35c3-4298-a108-01fa7493f77c for instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 on hv-cinder-84301 May 23 20:27:35.176255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-e85f1336-1bcb-4ffe-95a2-020e9bbe4aa4 req-6119971c-e397-4a62-bb09-ce5817919cd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041275 May 23 20:27:35.176842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 320/662] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:35.946940 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:35.947580 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:35.953794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:35.954208 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:35.954964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:35.955444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:36.181656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:36.182373 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:36.189167 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:36.189616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:36.190408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:36.190842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:36.334686 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:36.341590 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6e72fec9-b119-4cfa-93bc-46c04194f9d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.164729 May 23 20:27:36.342173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 321/663] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:36 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:36.387972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:36.396035 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:36.397780 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:36.398908 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-eda1c1b3-5e42-46fa-b6a9-d143fc646d0b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.456028 May 23 20:27:36.399457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 343/664] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:35 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:37.190693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-644a3e2a-c397-450e-a1d5-b998a6a79474 req-e61c4f70-cc4a-4671-9ffa-7a6d70c6ddef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23ab4da7-dfb5-4755-8ee9-f248b285e751", "tag": "7b51908c-35c3-4298-a108-01fa7493f77c"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:37.199043 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-644a3e2a-c397-450e-a1d5-b998a6a79474 req-e61c4f70-cc4a-4671-9ffa-7a6d70c6ddef service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:37.199503 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-644a3e2a-c397-450e-a1d5-b998a6a79474 req-e61c4f70-cc4a-4671-9ffa-7a6d70c6ddef service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:37.210290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-644a3e2a-c397-450e-a1d5-b998a6a79474 req-e61c4f70-cc4a-4671-9ffa-7a6d70c6ddef service nova] Creating event network-changed:7b51908c-35c3-4298-a108-01fa7493f77c for instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 on hv-cinder-84301 May 23 20:27:37.215059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-644a3e2a-c397-450e-a1d5-b998a6a79474 req-e61c4f70-cc4a-4671-9ffa-7a6d70c6ddef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028048 May 23 20:27:37.215647 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 322/665] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:37.357885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:37.358522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:37.366252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:37.366832 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:37.367679 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:37.368196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:37.417078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:37.417855 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:37.425051 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:37.425051 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:37.425769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:37.426444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:37.564985 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:37.573938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:37.576314 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:37.577914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a3e3048e-5244-4013-935c-5c2af8e73068 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.165034 May 23 20:27:37.578499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 323/666] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:37 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:27:37.592820 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:37.600210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c4dc2b9b-5f66-4389-b425-c104c696279c tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.246051 May 23 20:27:37.600775 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 344/667] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:37 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:38.596860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:38.597463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:38.599981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=4 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:38.600790 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=18 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:38.605935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:38.606414 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:38.607180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:38.607661 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:38.624987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:38.625700 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:38.633083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:38.633824 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:38.634841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:38.635464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:38.660662 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=6 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:38.749422 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:38.757319 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:38.758834 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:38.759927 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7fd774ac-97a2-4376-88f3-deaaccfe2c70 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.167521 May 23 20:27:38.760491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 324/668] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:38 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:38.772292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:38.779497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-22d903a3-0d56-4e40-a138-3d72365f0234 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.160073 May 23 20:27:38.780036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 345/669] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:38 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:39.777711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:39.778347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:39.784915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:39.785359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:39.786144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:39.786572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:39.796516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:39.797132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:39.804266 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:39.804715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:39.805479 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:39.805915 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:39.920893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:39.929912 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:39.931497 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:39.932837 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-92872745-1e83-43cb-8fe3-26a4d7e2da33 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.159070 May 23 20:27:39.933395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 325/670] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:39 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:39.935747 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:39.944025 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b520a7eb-76d4-42c1-8d24-35224266a8a6 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.151351 May 23 20:27:39.944574 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 346/671] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:39 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:40.209012 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-d553c9d7-2190-4e53-baaa-5085f968373a req-44abf965-083c-4fa4-a861-6e386637c565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22718422-007c-4e56-a5b2-5154cd7ad3b9", "name": "network-vif-plugged", "status": "completed", "tag": "9f6f0b95-22e5-471b-aabe-b625aff9995f"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:40.217312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-d553c9d7-2190-4e53-baaa-5085f968373a req-44abf965-083c-4fa4-a861-6e386637c565 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:40.217749 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-d553c9d7-2190-4e53-baaa-5085f968373a req-44abf965-083c-4fa4-a861-6e386637c565 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:40.230090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-d553c9d7-2190-4e53-baaa-5085f968373a req-44abf965-083c-4fa4-a861-6e386637c565 service nova] Creating event network-vif-plugged:9f6f0b95-22e5-471b-aabe-b625aff9995f for instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 on hv-cinder-84301 May 23 20:27:40.235042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-d553c9d7-2190-4e53-baaa-5085f968373a req-44abf965-083c-4fa4-a861-6e386637c565 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029755 May 23 20:27:40.235635 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 326/672] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:40.951415 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:40.952022 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:40.959327 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:40.959778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:40.960541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:40.960978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:40.966593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:40.967322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:40.974216 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:40.974676 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:40.975424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:40.975851 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:41.090656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:41.099434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:41.101044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:41.102216 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8a516b21-6377-4596-9a7c-8b60332ddeca tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.155056 May 23 20:27:41.102803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 347/673] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:40 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:41.113455 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:41.121072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-55b947e7-a1b9-4b8b-9468-e342d4bf17a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.158885 May 23 20:27:41.121712 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 327/674] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:40 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:42.119843 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:42.120468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:42.127036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:42.127482 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:42.128866 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:42.129299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:42.137226 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:42.137827 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:42.144300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:42.145486 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:42.145616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:42.146089 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:42.274575 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:42.284265 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:42.285763 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:42.286882 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4711c1b6-8a3a-4cc3-870a-1cae93330cad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.171057 May 23 20:27:42.287661 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 348/675] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:42 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:42.291891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-83268105-15c5-455a-8dcb-9a898294fb52 req-24a32076-873a-4d4b-8d5f-041eab2f6367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac", "name": "network-vif-plugged", "status": "completed", "tag": "d964f307-0816-459b-b91f-c56aa300d183"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:42.292636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:42.300509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-83268105-15c5-455a-8dcb-9a898294fb52 req-24a32076-873a-4d4b-8d5f-041eab2f6367 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:42.300947 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-83268105-15c5-455a-8dcb-9a898294fb52 req-24a32076-873a-4d4b-8d5f-041eab2f6367 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:42.305066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-12f29d7f-63ec-4d4c-9a07-4e0e453b50a0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1364 microversion: 2.1 time: 0.171574 May 23 20:27:42.305689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 328/676] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:42 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:42.312284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-83268105-15c5-455a-8dcb-9a898294fb52 req-24a32076-873a-4d4b-8d5f-041eab2f6367 service nova] Creating event network-vif-plugged:d964f307-0816-459b-b91f-c56aa300d183 for instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac on hv-cinder-84301 May 23 20:27:42.317421 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-83268105-15c5-455a-8dcb-9a898294fb52 req-24a32076-873a-4d4b-8d5f-041eab2f6367 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028880 May 23 20:27:42.318103 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 349/677] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:43.305678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:43.306301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:43.312740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.313186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.313933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.314390 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.327275 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:43.327962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:43.333997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.334465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.335215 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.335644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.447842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:43.456046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:43.457528 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:43.458660 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ae9e17d1-c670-4631-a56c-b76052429831 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.156868 May 23 20:27:43.459213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 329/678] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:43 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:43.463899 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:43.471607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-06e340b0-8d83-45ad-918e-4268db9c8d22 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1550 microversion: 2.1 time: 0.149221 May 23 20:27:43.472160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 350/679] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:43 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:43.488063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-57649d1b-05fd-4587-9101-a895b704058d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:43.488492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-57649d1b-05fd-4587-9101-a895b704058d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:43.494553 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57649d1b-05fd-4587-9101-a895b704058d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.495003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57649d1b-05fd-4587-9101-a895b704058d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.495757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57649d1b-05fd-4587-9101-a895b704058d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.496192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57649d1b-05fd-4587-9101-a895b704058d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.572049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-57649d1b-05fd-4587-9101-a895b704058d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088282 May 23 20:27:43.572636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 330/680] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:27:43 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:43.786882 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bc228bf-b00e-40ad-8052-c4e9a9b2745f"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:43.787946 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:43.793968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.794460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.795190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.795614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.872812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Invalid volume: volume 0bc228bf-b00e-40ad-8052-c4e9a9b2745f is already attached to instances: c8b5ec55-f363-4dd6-9d30-536d50973c81 May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: POST /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments HTTP/1.1 May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 74 May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:27:43.874557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {"volumeAttachment": {"volumeId": "0bc228bf-b00e-40ad-8052-c4e9a9b2745f"}} May 23 20:27:43.876128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Invalid volume: volume 0bc228bf-b00e-40ad-8052-c4e9a9b2745f is already attached to instances: c8b5ec55-f363-4dd6-9d30-536d50973c81 May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'server_id': 'c8b5ec55-f363-4dd6-9d30-536d50973c81', 'body': {'volumeAttachment': {'volumeId': '0bc228bf-b00e-40ad-8052-c4e9a9b2745f'}}} May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0bc228bf-b00e-40ad-8052-c4e9a9b2745f is already attached to instances: c8b5ec55-f363-4dd6-9d30-536d50973c81 May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:43.876934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0bc228bf-b00e-40ad-8052-c4e9a9b2745f is already attached to instances: c8b5ec55-f363-4dd6-9d30-536d50973c81 May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:43.878571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0bc228bf-b00e-40ad-8052-c4e9a9b2745f is already attached to instances: c8b5ec55-f363-4dd6-9d30-536d50973c81 May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 400 to user: Invalid volume: volume 0bc228bf-b00e-40ad-8052-c4e9a9b2745f is already attached to instances: c8b5ec55-f363-4dd6-9d30-536d50973c81 {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-00ee9422-ba5a-4041-8bd5-c9197372bc67 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093803 May 23 20:27:43.879743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 351/681] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:27:43 2022] POST /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 23 20:27:43.936539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:43.937104 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:43.943746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.944189 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:43.944949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:43.945467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:44.029240 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lazy-loading 'services' on Instance uuid c8b5ec55-f363-4dd6-9d30-536d50973c81 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:27:44.231970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b25d6eb2-6066-46a2-8528-fc5e068f9de2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments/0bc228bf-b00e-40ad-8052-c4e9a9b2745f" status: 202 len: 0 microversion: 2.1 time: 0.299251 May 23 20:27:44.232563 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 331/682] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:27:43 2022] DELETE /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments/0bc228bf-b00e-40ad-8052-c4e9a9b2745f => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:27:44.241685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-43c6468e-f6ab-4d62-93a8-d5c4dd137c5b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:44.242693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-43c6468e-f6ab-4d62-93a8-d5c4dd137c5b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:44.248766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43c6468e-f6ab-4d62-93a8-d5c4dd137c5b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:44.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43c6468e-f6ab-4d62-93a8-d5c4dd137c5b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:44.249943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43c6468e-f6ab-4d62-93a8-d5c4dd137c5b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:44.250403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43c6468e-f6ab-4d62-93a8-d5c4dd137c5b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:44.280228 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-43c6468e-f6ab-4d62-93a8-d5c4dd137c5b tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 May 23 20:27:44.280698 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 352/683] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:27:44 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:44.477716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:44.478566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:44.485679 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:44.486159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:44.487531 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:44.488179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:44.660402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-f1ce5ec4-8ef3-48c9-a2c6-c5e11aa88285 req-0df13371-45f4-49dd-9fd1-3d4ce4eb1ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22718422-007c-4e56-a5b2-5154cd7ad3b9", "tag": "9f6f0b95-22e5-471b-aabe-b625aff9995f"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:44.672575 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f1ce5ec4-8ef3-48c9-a2c6-c5e11aa88285 req-0df13371-45f4-49dd-9fd1-3d4ce4eb1ea7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:44.673027 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f1ce5ec4-8ef3-48c9-a2c6-c5e11aa88285 req-0df13371-45f4-49dd-9fd1-3d4ce4eb1ea7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:44.678078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:44.688443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:44.689976 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:44.691154 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f1979070-3ab1-47dd-b3d1-35e068843819 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1407 microversion: 2.20 time: 0.217713 May 23 20:27:44.691992 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 332/684] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:44 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:44.699348 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-f1ce5ec4-8ef3-48c9-a2c6-c5e11aa88285 req-0df13371-45f4-49dd-9fd1-3d4ce4eb1ea7 service nova] Creating event network-changed:9f6f0b95-22e5-471b-aabe-b625aff9995f for instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 on hv-cinder-84301 May 23 20:27:44.707265 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-f1ce5ec4-8ef3-48c9-a2c6-c5e11aa88285 req-0df13371-45f4-49dd-9fd1-3d4ce4eb1ea7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052533 May 23 20:27:44.708073 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 353/685] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:45.292330 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cd8b8b6b-7942-4ed7-bdf3-0b1994525e66 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:45.293782 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cd8b8b6b-7942-4ed7-bdf3-0b1994525e66 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:45.299969 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd8b8b6b-7942-4ed7-bdf3-0b1994525e66 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:45.300661 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd8b8b6b-7942-4ed7-bdf3-0b1994525e66 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:45.301501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd8b8b6b-7942-4ed7-bdf3-0b1994525e66 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:45.302258 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd8b8b6b-7942-4ed7-bdf3-0b1994525e66 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:45.334611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cd8b8b6b-7942-4ed7-bdf3-0b1994525e66 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 May 23 20:27:45.335182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 333/686] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:27:45 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:45.709338 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:45.709929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:45.716982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:45.717420 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:45.718223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:45.718653 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:45.851787 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:45.860760 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:45.862864 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:45.864396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-fbfa7ff6-7f02-4d58-bfea-40e5be2de3af tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1599 microversion: 2.20 time: 0.159369 May 23 20:27:45.865197 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 354/687] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:27:45 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:27:45.883037 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7d618a53-219d-4bd5-8640-1d345554c9ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:45.893500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7d618a53-219d-4bd5-8640-1d345554c9ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:45.893500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d618a53-219d-4bd5-8640-1d345554c9ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:45.893500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d618a53-219d-4bd5-8640-1d345554c9ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:45.893500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d618a53-219d-4bd5-8640-1d345554c9ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:45.893847 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7d618a53-219d-4bd5-8640-1d345554c9ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:45.967018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7d618a53-219d-4bd5-8640-1d345554c9ed tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087803 May 23 20:27:45.967624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 334/688] 10.222.0.16 () {60 vars in 1315 bytes} [Mon May 23 20:27:45 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:27:46.346751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c2157bc6-2337-4ca4-8d8c-b0640b19eead tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:46.347824 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c2157bc6-2337-4ca4-8d8c-b0640b19eead tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:46.353893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c2157bc6-2337-4ca4-8d8c-b0640b19eead tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:46.354442 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c2157bc6-2337-4ca4-8d8c-b0640b19eead tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:46.355285 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c2157bc6-2337-4ca4-8d8c-b0640b19eead tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:46.355796 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c2157bc6-2337-4ca4-8d8c-b0640b19eead tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:46.384773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c2157bc6-2337-4ca4-8d8c-b0640b19eead tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042647 May 23 20:27:46.385340 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 355/689] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:27:46 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:27:46.441752 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:46.443071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:46.448325 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:46.448832 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:46.449573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:46.450008 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:46.475559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:27:46.753771 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5355b550-8ccf-46d6-bce1-7b32ae9cfc91 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 204 len: 0 microversion: 2.1 time: 0.315537 May 23 20:27:46.754322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 335/690] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:27:46 2022] DELETE /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:27:46.762621 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:46.763238 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:46.770658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:46.771087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:46.771910 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:46.772342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:46.912430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:46.919886 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-33627a6e-075a-4a88-ac77-23edf3508dfc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1682 microversion: 2.1 time: 0.161237 May 23 20:27:46.920441 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 356/691] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:46 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:47.169901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-b15470b1-682b-4c76-8321-a82ecd5e14b3 req-56d40a4c-3ced-4348-b984-a03c154cf9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac", "tag": "d964f307-0816-459b-b91f-c56aa300d183"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:47.179002 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-b15470b1-682b-4c76-8321-a82ecd5e14b3 req-56d40a4c-3ced-4348-b984-a03c154cf9b2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:47.180083 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-b15470b1-682b-4c76-8321-a82ecd5e14b3 req-56d40a4c-3ced-4348-b984-a03c154cf9b2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:47.192965 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-b15470b1-682b-4c76-8321-a82ecd5e14b3 req-56d40a4c-3ced-4348-b984-a03c154cf9b2 service nova] Creating event network-changed:d964f307-0816-459b-b91f-c56aa300d183 for instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac on hv-cinder-84301 May 23 20:27:47.198042 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-b15470b1-682b-4c76-8321-a82ecd5e14b3 req-56d40a4c-3ced-4348-b984-a03c154cf9b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032058 May 23 20:27:47.198631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 336/692] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:47.936948 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:47.937557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:47.944095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:47.944552 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:47.945337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:47.945768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:48.076410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:48.084993 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c12ab424-e698-4417-95c2-f43bc5511f33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1682 microversion: 2.1 time: 0.151870 May 23 20:27:48.085566 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 357/693] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:47 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:49.103682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:49.104355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:49.110792 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:49.111234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:49.112555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:49.112986 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:49.131167 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:49.211558 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:49.219378 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a0c3d061-69bd-4a3d-93d5-345ead1a2492 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1615 microversion: 2.1 time: 0.119953 May 23 20:27:49.220033 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 337/694] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:49 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:49.331001 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-7f9ab96e-07ae-468f-b5e7-cb07478a93f3 req-738aa1a9-ce0e-4f73-b483-17f27c5efad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b5ec55-f363-4dd6-9d30-536d50973c81", "name": "network-vif-deleted", "tag": "3048d4fa-e347-4602-a678-0793975bd1e1"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:49.338008 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-7f9ab96e-07ae-468f-b5e7-cb07478a93f3 req-738aa1a9-ce0e-4f73-b483-17f27c5efad9 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:49.338498 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-7f9ab96e-07ae-468f-b5e7-cb07478a93f3 req-738aa1a9-ce0e-4f73-b483-17f27c5efad9 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:49.350833 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-7f9ab96e-07ae-468f-b5e7-cb07478a93f3 req-738aa1a9-ce0e-4f73-b483-17f27c5efad9 service nova] Creating event network-vif-deleted:3048d4fa-e347-4602-a678-0793975bd1e1 for instance c8b5ec55-f363-4dd6-9d30-536d50973c81 on hv-cinder-84301 May 23 20:27:49.355708 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-7f9ab96e-07ae-468f-b5e7-cb07478a93f3 req-738aa1a9-ce0e-4f73-b483-17f27c5efad9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030941 May 23 20:27:49.356506 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 358/695] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:50.237748 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:50.238394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:50.245475 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:50.245944 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:50.246718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:50.247154 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:50.278719 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:50.279190 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:50.279649 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lazy-loading 'fault' on Instance uuid c8b5ec55-f363-4dd6-9d30-536d50973c81 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:27:50.323550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:50.331677 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-27af8619-be30-4373-b173-ae5e41a0d456 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 200 len: 1332 microversion: 2.1 time: 0.098631 May 23 20:27:50.332236 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 338/696] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:50 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:51.351498 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:51.352191 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:51.358378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:51.358817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:51.359563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:51.359990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:51.372741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 HTTP/1.1 May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:27:51.374359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:27:51.375920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'c8b5ec55-f363-4dd6-9d30-536d50973c81'} May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:27:51.376955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:27:51.378990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:27:51.380371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:27:51.380371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-fc6e8aa7-afba-4ab8-a78c-c93bbf415fa6 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 404 len: 111 microversion: 2.1 time: 0.028870 May 23 20:27:51.380371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 359/697] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:51 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:27:51.384745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-53b0dd94-2167-420e-b82b-99c7c21f2e8c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '.version_select at 0x7f996d494ca0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:51.513531 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-53b0dd94-2167-420e-b82b-99c7c21f2e8c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874300486" status: 202 len: 0 microversion: 2.1 time: 0.132449 May 23 20:27:51.514043 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 339/698] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 20:27:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874300486 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:27:52.235846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bd587b3e-ddd6-4d30-b810-8dadc9a6e25a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: .version_select at 0x7f996cc63820>, body: {"keypair": {"name": "tempest-keypair-336624922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbKOlQTyjc4QAKqRNaCg+xBGg1rXv4W3YcFrI1ViL/HETXC+3eWIHwhLEMnauniNQ3tuvcZ7vdokndx4ekCvXzGk1RbOBObd6M6ZS6ZBp327UBGiDxDiTN1ELmsMYS0Fw=="}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:52.250338 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-bd587b3e-ddd6-4d30-b810-8dadc9a6e25a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:27:52.254174 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-bd587b3e-ddd6-4d30-b810-8dadc9a6e25a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'key_pairs'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:27:52.324469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bd587b3e-ddd6-4d30-b810-8dadc9a6e25a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092545 May 23 20:27:52.325286 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 360/699] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:27:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:27:54.320744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1287359136", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e834b06-191b-4f74-93c9-403bb39ced80"}], "security_groups": [{"name": "tempest-securitygroup--1094685508"}], "key_name": "tempest-keypair-336624922", "user_data": "}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:54.418743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] validate_networks() for [('2e834b06-191b-4f74-93c9-403bb39ced80', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:27:54.773235 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:27:54.773681 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:27:54.774272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:27:54.774651 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:27:54.775059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:27:54.783756 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:54.784199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:54.784977 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:54.785404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:54.802003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:27:54.805853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Getting quotas for user 954933c1cb0249c2a86b309b6f8a334c and project cb1d9be9203346cd8cf364305116abf1. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:27:54.817121 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:27:54.819446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:27:54.941844 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c8cd75da-8711-41fd-87d3-7e1b228f3f0d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.626126 May 23 20:27:54.942533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 340/700] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:27:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:27:54.953453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3c1184f7-95a8-4fe2-adbe-20811e178b85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:54.954100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3c1184f7-95a8-4fe2-adbe-20811e178b85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:55.008814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3c1184f7-95a8-4fe2-adbe-20811e178b85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:55.016328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3c1184f7-95a8-4fe2-adbe-20811e178b85 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1241 microversion: 2.1 time: 0.067574 May 23 20:27:55.016871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 361/701] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:54 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:56.032883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:56.033492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:56.041471 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:56.041926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:56.042710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:56.043148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:56.107137 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:56.114643 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6fe51f69-30f6-4985-a4c3-1a8d26c2d6cf tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1237 microversion: 2.1 time: 0.085681 May 23 20:27:56.115215 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 341/702] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:56 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:56.899008 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:56.899538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:56.906398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:56.906842 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:56.911142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:56.911142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:56.911828 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:56.931372 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lazy-loading 'flavor' on Instance uuid 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:27:57.136730 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:57.137335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:57.143894 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:57.144339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:57.145100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:57.145539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:57.213403 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:57.221114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d132c5fc-53fe-43ab-a05a-92c35aee919f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1299 microversion: 2.1 time: 0.088272 May 23 20:27:57.222417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 342/703] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:57 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:27:57.243808 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-98bc3160-4ddd-4922-937f-e0e1c7a04795 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "POST /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18/action" status: 202 len: 0 microversion: 2.1 time: 0.348600 May 23 20:27:57.244380 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 362/704] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:27:56 2022] POST /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:27:57.252616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:57.253507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:57.259367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:57.261277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:57.261277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:57.261277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:57.484767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:57.493575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-384c00bd-199b-41ee-81aa-11c508012193 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.244780 May 23 20:27:57.496088 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 343/705] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:57 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:58.239375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:58.240079 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:58.246648 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:58.247107 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:58.247867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:58.248346 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:58.337139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-96b866c3-f6a0-466c-a65c-2968854a70ee req-7c178b81-e9ef-440f-90c9-c0e61fbe0791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca0fa62-1631-4060-a2be-7f7fc3759ed1", "tag": "b48e4170-0403-4340-9bca-730f726da90b"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:27:58.346480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:27:58.348785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-96b866c3-f6a0-466c-a65c-2968854a70ee req-7c178b81-e9ef-440f-90c9-c0e61fbe0791 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:58.349259 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-96b866c3-f6a0-466c-a65c-2968854a70ee req-7c178b81-e9ef-440f-90c9-c0e61fbe0791 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:58.369844 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-96b866c3-f6a0-466c-a65c-2968854a70ee req-7c178b81-e9ef-440f-90c9-c0e61fbe0791 service nova] Creating event network-changed:b48e4170-0403-4340-9bca-730f726da90b for instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 on hv-cinder-84301 May 23 20:27:58.375270 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-96b866c3-f6a0-466c-a65c-2968854a70ee req-7c178b81-e9ef-440f-90c9-c0e61fbe0791 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048460 May 23 20:27:58.376072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 344/706] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:27:58.394267 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:58.406293 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d266564c-f50c-41d5-bfbd-5c68958f7ff2 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.172115 May 23 20:27:58.407014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 363/707] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:58 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:58.511349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:58.512080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:58.519047 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:58.519494 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:58.520328 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:58.520767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:59.000267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:59.008494 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8455a8f6-5d0c-4b0a-b8dc-06c77aa0828f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.501508 May 23 20:27:59.009270 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 345/708] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:58 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:27:59.423504 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:27:59.424146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:27:59.431291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:59.431736 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:59.436857 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:27:59.436857 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:27:59.561587 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:27:59.568891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3e23b7fa-9151-4949-a887-95f978401c65 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.149289 May 23 20:27:59.574512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 364/709] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:27:59 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:00.025991 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:00.026567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:00.033367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:00.033826 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:00.035197 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:00.035629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:00.164546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:00.171993 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d5c47b84-7f5f-4b08-a9a3-7541ec27dbb4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.149993 May 23 20:28:00.172552 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 346/710] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:00 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:00.586000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:00.586634 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:00.593049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:00.593496 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:00.594286 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:00.594723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:00.774808 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:00.782376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9fa6858f-2a43-4aff-8488-0c1524570a8a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.200171 May 23 20:28:00.783065 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 365/711] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:00 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:01.189053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:01.189580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:01.196107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:01.196559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:01.197312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:01.197750 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:01.325334 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:01.333354 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7e673fa8-3a10-4318-bd39-2299c6abb519 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.148268 May 23 20:28:01.333920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 347/712] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:01 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:01.799018 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:01.799662 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:01.806203 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:01.806655 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:01.807416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:01.807852 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:01.932796 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:01.940652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f0b3d657-21ce-44f0-a2a8-bbff3c441de5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.144942 May 23 20:28:01.941217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 366/713] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:01 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:02.350295 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:02.350973 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:02.357381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:02.357823 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:02.358607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:02.359044 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:02.491567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:02.499021 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-91ad5922-df67-4401-94a8-6b8c680a9a18 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.152627 May 23 20:28:02.499566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 348/714] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:02 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:02.957445 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:02.958076 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:02.960570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:02.965333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:02.965773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:02.966572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:02.967001 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:03.092560 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:03.100411 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-60881e09-04f1-451f-9fb8-01bcdbe4ffcc tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.147290 May 23 20:28:03.100957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 367/715] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:02 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:03.515189 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:03.515729 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:03.522384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:03.522837 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:03.523600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:03.524040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:03.651681 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:03.659008 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-23eb7db2-88e9-4afa-ba10-d3114973bef9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.147795 May 23 20:28:03.659559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 349/716] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:03 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:04.117773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:04.118667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:04.125029 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:04.125466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:04.126324 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:04.126757 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:04.270996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:04.278347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d59d38a4-0019-4a5b-a1b1-c5ca53c88fc8 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.165071 May 23 20:28:04.278916 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 368/717] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:04 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:04.675714 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:04.676351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:04.683043 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:04.683486 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:04.684231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:04.684666 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:04.792805 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:04.812706 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:04.818371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:04.826077 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6b6dd491-6821-4641-b68d-d1194f944be3 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.154145 May 23 20:28:04.826644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 350/718] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:04 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:05.296053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:05.296622 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:05.298578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=6 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:05.304495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:05.304941 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:05.305719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:05.306178 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:05.437733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:05.445139 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9719c7f8-af09-4907-afb5-fc25ebf667a5 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.153067 May 23 20:28:05.445687 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 369/719] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:05 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:05.844273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:05.844814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:05.852472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:05.852916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:05.853672 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:05.854137 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:05.983574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:05.991073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c1f98342-610f-4b4b-a1ff-09a512a030df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.151110 May 23 20:28:05.991628 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 351/720] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:05 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:06.331452 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-6f652439-5127-4862-9142-568a30e7f6ad req-5e829438-5fcb-47ef-9e25-1e6cead9a08e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca0fa62-1631-4060-a2be-7f7fc3759ed1", "name": "network-vif-plugged", "status": "completed", "tag": "b48e4170-0403-4340-9bca-730f726da90b"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:06.339992 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-6f652439-5127-4862-9142-568a30e7f6ad req-5e829438-5fcb-47ef-9e25-1e6cead9a08e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:06.340424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-6f652439-5127-4862-9142-568a30e7f6ad req-5e829438-5fcb-47ef-9e25-1e6cead9a08e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:06.351097 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-6f652439-5127-4862-9142-568a30e7f6ad req-5e829438-5fcb-47ef-9e25-1e6cead9a08e service nova] Creating event network-vif-plugged:b48e4170-0403-4340-9bca-730f726da90b for instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 on hv-cinder-84301 May 23 20:28:06.355787 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-6f652439-5127-4862-9142-568a30e7f6ad req-5e829438-5fcb-47ef-9e25-1e6cead9a08e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028649 May 23 20:28:06.356342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 370/721] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:06.462765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:06.463374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:06.469263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:06.472297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:06.472297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:06.472297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:06.600888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:06.608698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ff032601-16b9-468a-8711-f2ad7fcd3a7c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.149837 May 23 20:28:06.609255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 352/722] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:06 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:07.008700 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:07.009347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:07.015600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:07.016046 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:07.016800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:07.017233 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:07.149914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:07.157326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-580202d6-d505-4428-b012-6ff191754dc1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.152933 May 23 20:28:07.157877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 371/723] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:07 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:07.625382 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:07.625998 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:07.633058 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:07.633513 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:07.634299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:07.634743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:07.765506 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:07.773557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3fffd7fe-1bf3-413f-947c-f85ae992e105 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1367 microversion: 2.1 time: 0.151999 May 23 20:28:07.774134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 353/724] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:07 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:08.175272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:08.175872 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:08.182269 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:08.182732 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:08.183477 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:08.183900 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:08.312055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:08.319934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1d8a9044-eb97-4e09-96c6-a7418a0ca427 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.149132 May 23 20:28:08.320495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 372/725] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:08 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:08.790271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:08.790921 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:08.797598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:08.798081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:08.798846 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:08.799284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:08.932274 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:08.939693 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-62f72ebb-b02f-4db1-b7a4-4a1f629f44e7 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1557 microversion: 2.1 time: 0.153298 May 23 20:28:08.940860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 354/726] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:08 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:08.956881 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-60e84ce9-51e3-4756-99de-ffee8278459e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:08.957374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-60e84ce9-51e3-4756-99de-ffee8278459e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:08.963594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60e84ce9-51e3-4756-99de-ffee8278459e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:08.964036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60e84ce9-51e3-4756-99de-ffee8278459e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:08.964793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60e84ce9-51e3-4756-99de-ffee8278459e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:08.965255 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-60e84ce9-51e3-4756-99de-ffee8278459e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:08.999498 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:08.999919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:09.006824 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:09.007281 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:09.008066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:09.008508 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:09.033184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:28:09.042434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-60e84ce9-51e3-4756-99de-ffee8278459e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089355 May 23 20:28:09.043221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 373/727] 10.222.0.16 () {58 vars in 1274 bytes} [Mon May 23 20:28:08 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:28:09.048430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:09.289649 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-01b1bea9-897c-431a-af32-53fdfc4a8c52 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 204 len: 0 microversion: 2.1 time: 0.293623 May 23 20:28:09.290373 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 355/728] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:28:08 2022] DELETE /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 20:28:09.298994 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:09.300161 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:09.306247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:09.306689 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:09.307453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:09.307891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:09.337032 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:09.337736 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:09.344095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:09.344385 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:09.345554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:09.345948 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:09.444446 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:09.452581 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a8e0f9fa-9eb0-4e52-a841-3f55c19c7b6e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1575 microversion: 2.1 time: 0.157964 May 23 20:28:09.453148 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 374/729] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:09 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:09.556254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:09.564033 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1d73dde1-6bbe-4c3d-9699-e38e3af35d58 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.231178 May 23 20:28:09.564592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 356/730] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:09 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:10.081554 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-76b3f330-3bfb-43b6-9eda-75aa840f6426 req-7052efad-059c-42f6-80ea-13e8477ff755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca0fa62-1631-4060-a2be-7f7fc3759ed1", "tag": "b48e4170-0403-4340-9bca-730f726da90b"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:10.089985 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-76b3f330-3bfb-43b6-9eda-75aa840f6426 req-7052efad-059c-42f6-80ea-13e8477ff755 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:10.090463 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-76b3f330-3bfb-43b6-9eda-75aa840f6426 req-7052efad-059c-42f6-80ea-13e8477ff755 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:10.101534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-76b3f330-3bfb-43b6-9eda-75aa840f6426 req-7052efad-059c-42f6-80ea-13e8477ff755 service nova] Creating event network-changed:b48e4170-0403-4340-9bca-730f726da90b for instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 on hv-cinder-84301 May 23 20:28:10.106371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-76b3f330-3bfb-43b6-9eda-75aa840f6426 req-7052efad-059c-42f6-80ea-13e8477ff755 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029131 May 23 20:28:10.106955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 375/731] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:10.469995 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:10.470724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:10.477545 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:10.477998 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:10.478804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:10.479245 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:10.582755 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:10.584164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:10.590976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:10.592192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:10.592583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:10.593083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:10.618381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:10.627014 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-287a16d1-3b80-4073-a170-3e3e2ac70610 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1575 microversion: 2.1 time: 0.160864 May 23 20:28:10.628593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 357/732] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:10 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:10.732527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:10.740806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-52a17f7c-91d6-4556-8b5e-f9889df4f202 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.163593 May 23 20:28:10.741366 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 376/733] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:10 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:11.645272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:11.645905 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:11.652734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:11.653183 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:11.653942 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:11.654406 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:11.729175 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:11.737827 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-433be52f-08b2-4a75-81e3-3d0456b578aa tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1508 microversion: 2.1 time: 0.097066 May 23 20:28:11.745427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 358/734] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:11 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1508 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:11.758362 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:11.759088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:11.766471 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:11.766985 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:11.767800 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:11.768296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:11.950448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:11.957854 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9cbf7d16-a514-438a-ba33-b41a36ee79b8 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.203682 May 23 20:28:11.958456 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 377/735] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:11 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:12.052772 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-c07a6898-5f9e-47a6-900b-4889d59ba63c req-6446aacc-1819-432d-aef6-0d233a65233c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee0bc7f-636f-4b77-bbf0-90e168f07e57", "name": "network-vif-deleted", "tag": "900b532d-cbf1-4f24-96e1-9501a7768ef8"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:12.061092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-c07a6898-5f9e-47a6-900b-4889d59ba63c req-6446aacc-1819-432d-aef6-0d233a65233c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:12.061540 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-c07a6898-5f9e-47a6-900b-4889d59ba63c req-6446aacc-1819-432d-aef6-0d233a65233c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:12.075791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-c07a6898-5f9e-47a6-900b-4889d59ba63c req-6446aacc-1819-432d-aef6-0d233a65233c service nova] Creating event network-vif-deleted:900b532d-cbf1-4f24-96e1-9501a7768ef8 for instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 on hv-cinder-84301 May 23 20:28:12.079195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-c07a6898-5f9e-47a6-900b-4889d59ba63c req-6446aacc-1819-432d-aef6-0d233a65233c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030574 May 23 20:28:12.080033 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 359/736] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:12.756788 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:12.757433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:12.764601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:12.765724 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:12.766701 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:12.767164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:12.784385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:12.804753 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:12.805312 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:12.805846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lazy-loading 'fault' on Instance uuid 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:12.855307 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:12.863250 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0bb632f8-1da7-4f3b-958f-8404dc2069f4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 200 len: 1231 microversion: 2.1 time: 0.110370 May 23 20:28:12.863943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 378/737] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:12 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:12.975125 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:12.975870 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:12.982508 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:12.982955 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:12.983716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:12.984142 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:13.120533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:13.130837 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fc7b3138-e3cb-4c37-9780-e6ebab093c13 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.159827 May 23 20:28:13.131827 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 360/738] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:12 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:13.212322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:13.212811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:13.219861 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:13.220676 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:13.221538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:13.222251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:13.313216 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lazy-loading 'services' on Instance uuid 23ab4da7-dfb5-4755-8ee9-f248b285e751 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:13.563184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a25440ac-1145-45b2-959a-1b90de880edd tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments/9958da5d-38f0-4497-b637-fafedda57340" status: 202 len: 0 microversion: 2.1 time: 0.354813 May 23 20:28:13.563773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 379/739] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:28:13 2022] DELETE /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments/9958da5d-38f0-4497-b637-fafedda57340 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:28:13.573093 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2e2a7ac4-85e2-4a2f-8ff3-0a9f300aedd1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:13.574049 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2e2a7ac4-85e2-4a2f-8ff3-0a9f300aedd1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:13.580913 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e2a7ac4-85e2-4a2f-8ff3-0a9f300aedd1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:13.581368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e2a7ac4-85e2-4a2f-8ff3-0a9f300aedd1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:13.582178 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e2a7ac4-85e2-4a2f-8ff3-0a9f300aedd1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:13.582751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e2a7ac4-85e2-4a2f-8ff3-0a9f300aedd1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:13.612769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2e2a7ac4-85e2-4a2f-8ff3-0a9f300aedd1 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043631 May 23 20:28:13.613483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 361/740] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:13 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:13.881524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:13.882247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:13.888494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:13.888939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:13.889699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:13.890159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:13.902968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] HTTP exception thrown: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Request method failure captured: May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 HTTP/1.1 May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-2PstBqqCEBz2pTMw1lH6sDEhs_aa2I4a5nNtSSoI7QkPCpq7RzwPD94KXn17y3V2nzJoUD_GHuYZzMIHdi0WuxhEa1_JaYhlcpgu6AdI9E2BHPZKXPfdlVJ0OKsHkUjTFjobUb7fCf-C5HNqf5ESlEU3zACEQXPsSNHclYvFkM7b4 May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 26567fb564314003bf5ae836737b990e May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:28:13.904540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26567fb564314003bf5ae836737b990e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26567fb564314003bf5ae836737b990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}] May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-TestVolumeBootPattern-529201914 May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 26567fb564314003bf5ae836737b990e May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-TestVolumeBootPattern-529201914-project May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 7231b60e5f9541629fec2291c547f0f4 May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-TestVolumeBootPattern-529201914-project May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:28:13.906044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '2ee0bc7f-636f-4b77-bbf0-90e168f07e57'} May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:28:13.906870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:28:13.908279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:28:13.910083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Returning 404 to user: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:28:13.910083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-20d2f3dd-180b-40b4-8577-4c4602ada8c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 404 len: 111 microversion: 2.1 time: 0.029108 May 23 20:28:13.910083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 380/741] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:13 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:28:13.998449 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1890808878", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2119033645", "security_groups": [{"name": "tempest-secgroup-smoke-560179066"}], "block_device_mapping_v2": [{"uuid": "6174effb-0f6b-4734-a2f2-2994c860df4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d1b674a5-f902-453a-bbbe-6a61eb453929"}]}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:14.107629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] validate_networks() for [('d1b674a5-f902-453a-bbbe-6a61eb453929', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:28:14.148207 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:14.148818 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:14.154839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:14.155291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:14.156073 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:14.156508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:14.293523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:14.301078 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1183bbd7-fbd7-4515-add9-d34de9c2c43a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.156660 May 23 20:28:14.301641 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 381/742] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:14 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:14.516251 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:28:14.516695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:28:14.517166 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:28:14.517566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:28:14.518576 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:28:14.527673 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:14.528115 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:14.528901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:14.529331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:14.545404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for project 26567fb564314003bf5ae836737b990e. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:28:14.549330 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for user 7231b60e5f9541629fec2291c547f0f4 and project 26567fb564314003bf5ae836737b990e. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:28:14.605176 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:28:14.607273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6174effb-0f6b-4734-a2f2-2994c860df4c',volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:28:14.624636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c8dcc043-a4de-4006-89bd-ddfb6b16a5df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:14.625742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c8dcc043-a4de-4006-89bd-ddfb6b16a5df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:14.632615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8dcc043-a4de-4006-89bd-ddfb6b16a5df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:14.633069 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8dcc043-a4de-4006-89bd-ddfb6b16a5df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:14.633838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8dcc043-a4de-4006-89bd-ddfb6b16a5df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:14.634296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8dcc043-a4de-4006-89bd-ddfb6b16a5df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:14.663777 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c8dcc043-a4de-4006-89bd-ddfb6b16a5df tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 May 23 20:28:14.665749 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 382/743] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:14 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:14.964357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d40c39a8-e3f9-404f-9716-06e32369bb64 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.969697 May 23 20:28:14.964984 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 362/744] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:28:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:28:14.974955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-402bc417-105a-4010-adbd-771aea46fc4b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:14.975648 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-402bc417-105a-4010-adbd-771aea46fc4b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:15.029131 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-402bc417-105a-4010-adbd-771aea46fc4b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:15.035844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-402bc417-105a-4010-adbd-771aea46fc4b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1095 microversion: 2.1 time: 0.064716 May 23 20:28:15.036411 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 383/745] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:14 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:15.318600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:15.319213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:15.326219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:15.326672 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:15.327439 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:15.327878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:15.467982 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:15.476133 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-24cd3916-3d4a-425f-a48a-5215170533db tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.161858 May 23 20:28:15.477789 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 363/746] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:15 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:15.675544 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-78c307f2-cb3c-47f6-8f63-d6910cdbec07 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:15.676399 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-78c307f2-cb3c-47f6-8f63-d6910cdbec07 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:15.683286 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78c307f2-cb3c-47f6-8f63-d6910cdbec07 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:15.684395 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78c307f2-cb3c-47f6-8f63-d6910cdbec07 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:15.684695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78c307f2-cb3c-47f6-8f63-d6910cdbec07 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:15.685143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-78c307f2-cb3c-47f6-8f63-d6910cdbec07 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:15.714991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-78c307f2-cb3c-47f6-8f63-d6910cdbec07 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 May 23 20:28:15.715526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 384/747] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:15 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:16.052606 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:16.053442 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:16.059706 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.060151 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.060908 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.061340 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.126162 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:16.134115 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d6b1fd0b-836a-446d-8c56-b3b2430afbca tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1137 microversion: 2.1 time: 0.085366 May 23 20:28:16.134919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 364/748] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:16 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:16.493673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:16.494228 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:16.500201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.500648 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.501406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.501838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.633207 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:16.640772 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7f2d4962-160f-4fec-936f-c22bb71d1373 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.151249 May 23 20:28:16.641325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 385/749] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:16 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:16.728296 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4aadd919-96ce-48e6-909d-016a7a5b5ed4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:16.729400 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4aadd919-96ce-48e6-909d-016a7a5b5ed4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:16.736791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4aadd919-96ce-48e6-909d-016a7a5b5ed4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.737327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4aadd919-96ce-48e6-909d-016a7a5b5ed4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.739083 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4aadd919-96ce-48e6-909d-016a7a5b5ed4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.739525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4aadd919-96ce-48e6-909d-016a7a5b5ed4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.768757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4aadd919-96ce-48e6-909d-016a7a5b5ed4 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044595 May 23 20:28:16.769249 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 365/750] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:16 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:28:16.845803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:16.847266 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:16.853698 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.854310 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.855190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:16.855758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:16.882903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:28:17.151184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:17.152132 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:17.157954 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-51e7ef1b-8dfd-4489-a0b5-4958dfefacae tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "DELETE /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 204 len: 0 microversion: 2.1 time: 0.315877 May 23 20:28:17.162230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 386/751] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:28:16 2022] DELETE /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:28:17.163335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.163787 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:17.164842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.165289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:17.175226 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:17.175923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:17.184027 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.184708 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:17.189335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.189335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:17.270538 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:17.285584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d746be4b-88e7-4530-bd96-e243fb7987e6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1211 microversion: 2.1 time: 0.138197 May 23 20:28:17.291477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 366/752] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:17 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1211 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:17.377844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:17.386364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a4670558-6a18-459d-b319-2df915f0bfaf tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1687 microversion: 2.1 time: 0.215628 May 23 20:28:17.392653 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 387/753] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:17 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1687 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:17.658115 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:17.658788 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:17.664848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.665293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:17.669559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.669559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:17.795950 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:17.803240 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d8373258-87f2-4308-86d8-3a4c33741ddb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1509 microversion: 2.1 time: 0.149250 May 23 20:28:17.803798 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 367/754] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:17 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:17.820148 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-978f127c-9b9a-4421-ba8d-71f2b6344368 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:17.821602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-978f127c-9b9a-4421-ba8d-71f2b6344368 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:17.828954 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-978f127c-9b9a-4421-ba8d-71f2b6344368 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.832646 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-978f127c-9b9a-4421-ba8d-71f2b6344368 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:17.832646 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-978f127c-9b9a-4421-ba8d-71f2b6344368 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:17.832646 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-978f127c-9b9a-4421-ba8d-71f2b6344368 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.000001 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-978f127c-9b9a-4421-ba8d-71f2b6344368 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "POST /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18/action" status: 202 len: 0 microversion: 2.1 time: 0.184273 May 23 20:28:18.004268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 388/755] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:28:17 2022] POST /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:28:18.009779 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:18.010424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:18.016678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:18.017323 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.018291 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:18.018882 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.170335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:18.179011 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1d57c90a-32bb-4756-a44e-02cbe1bfa8df tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1517 microversion: 2.1 time: 0.173043 May 23 20:28:18.179865 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 368/756] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:18 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:18.305269 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-2bda6227-e98f-45c0-870d-da849be08932 req-36bde0ef-9aa8-41f1-bc1e-3a1d8a964a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18", "name": "network-vif-unplugged", "status": "completed", "tag": "e3fbb816-fd5a-4989-8f75-4be912227768"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:18.310960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:18.314594 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:18.318092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:18.318824 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.319907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:18.320468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-2bda6227-e98f-45c0-870d-da849be08932 req-36bde0ef-9aa8-41f1-bc1e-3a1d8a964a1c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:18.320585 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.320914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-2bda6227-e98f-45c0-870d-da849be08932 req-36bde0ef-9aa8-41f1-bc1e-3a1d8a964a1c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.334860 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.compute.server_external_events [req-2bda6227-e98f-45c0-870d-da849be08932 req-36bde0ef-9aa8-41f1-bc1e-3a1d8a964a1c service nova] Unable to find a host for instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18. Dropping event network-vif-unplugged {{(pid=118170) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 20:28:18.335831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-2bda6227-e98f-45c0-870d-da849be08932 req-36bde0ef-9aa8-41f1-bc1e-3a1d8a964a1c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034729 May 23 20:28:18.336667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 389/757] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 20:28:18.404400 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:18.405019 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:18.411814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:18.412347 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.413407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:18.413582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:18.463220 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:18.469081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a3548647-b2f5-4353-a873-da04de0fb1fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1278 microversion: 2.1 time: 0.169641 May 23 20:28:18.469695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 369/758] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:18 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:18.548897 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:18.556712 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-65a379ec-e074-4709-98ab-8b872d1de473 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1687 microversion: 2.1 time: 0.156187 May 23 20:28:18.557273 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 390/759] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:18 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:19.195769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:19.196367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:19.203283 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:19.203731 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:19.204475 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:19.204904 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:19.336072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:19.343539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6e8d4211-6e67-44e9-bc8d-58aeea5d8e44 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1517 microversion: 2.1 time: 0.151837 May 23 20:28:19.344105 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 370/760] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:19 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:19.486224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:19.486760 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:19.492990 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:19.493435 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:19.494227 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:19.494664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:19.573763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:19.574399 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:19.580799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:19.581751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:19.582565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:19.583001 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:19.622569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:19.630557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-16d74427-69e7-44bd-8315-350e18de3f72 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1278 microversion: 2.1 time: 0.148201 May 23 20:28:19.631121 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 391/761] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:19 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:19.711567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:19.718974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3f1dfeb5-bfc2-46f7-af73-54ac4f2fc058 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1687 microversion: 2.1 time: 0.149066 May 23 20:28:19.719531 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 371/762] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:19 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:20.361082 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:20.361728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:20.368814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:20.369323 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:20.370078 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:20.370513 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:20.501527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:20.509197 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a0b91995-1696-4fd1-b230-5c833bffa02f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1517 microversion: 2.1 time: 0.151977 May 23 20:28:20.510045 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 392/763] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:20 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:20.646660 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:20.647279 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:20.653963 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:20.654498 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:20.655198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:20.655633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:20.674608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:20.736047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:20.736668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:20.747460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:20.747928 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:20.751542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:20.751989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:20.800077 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:20.808322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ddd5137f-00ed-4e00-80c9-44b25da71b19 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1278 microversion: 2.1 time: 0.165524 May 23 20:28:20.809084 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 372/764] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:20 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:20.970141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:20.973522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:20.979469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-54b1168a-2286-4bc1-b1d2-a451fcd0b342 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1687 microversion: 2.1 time: 0.247946 May 23 20:28:20.993387 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 393/765] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:20 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1687 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:21.496140 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-22b1fc0f-14c7-435c-a238-09103d376103 req-b0c28f0b-1289-4b12-9a83-a8e0bf468690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd76191-07fb-44e2-af58-b6a847a04996", "tag": "ded069bc-1e0c-448e-8af6-6ea2d76dc8f8"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:21.505563 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-22b1fc0f-14c7-435c-a238-09103d376103 req-b0c28f0b-1289-4b12-9a83-a8e0bf468690 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:21.505793 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-22b1fc0f-14c7-435c-a238-09103d376103 req-b0c28f0b-1289-4b12-9a83-a8e0bf468690 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:21.521487 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-22b1fc0f-14c7-435c-a238-09103d376103 req-b0c28f0b-1289-4b12-9a83-a8e0bf468690 service nova] Creating event network-changed:ded069bc-1e0c-448e-8af6-6ea2d76dc8f8 for instance fdd76191-07fb-44e2-af58-b6a847a04996 on hv-cinder-84301 May 23 20:28:21.522800 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-22b1fc0f-14c7-435c-a238-09103d376103 req-b0c28f0b-1289-4b12-9a83-a8e0bf468690 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030282 May 23 20:28:21.523395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 373/766] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:21.526088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:21.527477 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:21.535902 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:21.536618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:21.538408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:21.539529 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:21.805681 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:21.826971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:21.829138 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:21.829458 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-880769b0-df89-4a96-b564-d575ef8ec63f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1519 microversion: 2.1 time: 0.307353 May 23 20:28:21.841573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:21.842047 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:21.843072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 394/767] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:21 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:21.847904 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:21.848610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:21.996576 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:21.997423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:22.005091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:22.005720 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:22.015814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:22.016283 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:22.102191 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:22.114428 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-99e1b11b-9e13-4659-ad21-ca49bb4e6638 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.293213 May 23 20:28:22.124171 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 374/768] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:21 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:22.131492 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:22.146679 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6391ad9d-91c7-4234-899c-7e28115d5c26 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1620 microversion: 2.1 time: 0.153920 May 23 20:28:22.148561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 395/769] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:21 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1620 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:22.331942 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-881506aa-91a7-4752-81ff-9a03510ee373 req-9bb65410-78ab-4743-9646-06b7e6e056f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23ab4da7-dfb5-4755-8ee9-f248b285e751", "name": "network-vif-deleted", "tag": "7b51908c-35c3-4298-a108-01fa7493f77c"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:22.347746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-881506aa-91a7-4752-81ff-9a03510ee373 req-9bb65410-78ab-4743-9646-06b7e6e056f3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:22.350183 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-881506aa-91a7-4752-81ff-9a03510ee373 req-9bb65410-78ab-4743-9646-06b7e6e056f3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:22.362754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-881506aa-91a7-4752-81ff-9a03510ee373 req-9bb65410-78ab-4743-9646-06b7e6e056f3 service nova] Creating event network-vif-deleted:7b51908c-35c3-4298-a108-01fa7493f77c for instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 on hv-cinder-84301 May 23 20:28:22.369449 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-881506aa-91a7-4752-81ff-9a03510ee373 req-9bb65410-78ab-4743-9646-06b7e6e056f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121166 May 23 20:28:22.371510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 375/770] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:22.847462 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:22.848019 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:22.854700 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:22.855142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:22.855929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:22.856337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:23.024512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:23.032558 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d00cd91b-a79c-4581-9129-073b63d02b16 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.189087 May 23 20:28:23.033116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 396/771] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:22 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:23.132976 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:23.133709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:23.140053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:23.142808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:23.142808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:23.142808 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:23.168584 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:23.169419 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:23.176147 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:23.176840 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:23.177669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:23.178329 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:23.219656 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:23.220382 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:23.220997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lazy-loading 'fault' on Instance uuid 23ab4da7-dfb5-4755-8ee9-f248b285e751 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:23.265678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:23.273429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6def563f-8fcb-4602-89bc-f3693b780a87 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 200 len: 1334 microversion: 2.1 time: 0.108708 May 23 20:28:23.282403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 397/772] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:23 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:23.293869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:23.301789 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d7f4be04-6d95-43ef-9b7d-38e2a090e94c tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.174215 May 23 20:28:23.302371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 376/773] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:23 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:24.048647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:24.049189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:24.055803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:24.056245 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:24.056989 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:24.057416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:24.184343 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:24.191681 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2690eda8-0040-4237-9d0e-8bbbd2f9ee91 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.146973 May 23 20:28:24.192231 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 398/774] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:24 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:24.318450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:24.319056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:24.325220 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:24.325661 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:24.326444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:24.326985 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:24.341446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:24.342281 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 23ab4da7-dfb5-4755-8ee9-f248b285e751] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:24.348771 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:24.349287 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:24.350133 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:24.350640 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:24.366993 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] HTTP exception thrown: Instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 could not be found. May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Request method failure captured: May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 HTTP/1.1 May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-060eSaldOSLPXRVhNUGhvociZGC633JEFPxVVHDtDuTPKx4PMyR1lIM71oxfnHfneq-9jWF2_d1xuS-KO1638uBEGF8IK556x2rqNWNBql86zLjbH3Fh-HCnDw4VyLmnV4oDUnZl2OAfUpH2YPeb_3IpsvknLOlDpldliwLOEWJG8 May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:28:24.368629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02969314f19c4dc182b0dbe76aad9a34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}] May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: feb66e681a894c148e3463ff5a0dd1be May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 could not be found. May 23 20:28:24.370293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '23ab4da7-dfb5-4755-8ee9-f248b285e751'} May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 could not be found. May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:28:24.371307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 could not be found. May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 could not be found. May 23 20:28:24.372920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:24.374394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Returning 404 to user: Instance 23ab4da7-dfb5-4755-8ee9-f248b285e751 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:28:24.374394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f9d2ef8f-c23c-4472-87b0-0ad3a1d8843b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751" status: 404 len: 111 microversion: 2.1 time: 0.082834 May 23 20:28:24.374394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 377/775] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:24 2022] GET /compute/v2.1/servers/23ab4da7-dfb5-4755-8ee9-f248b285e751 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:28:24.378453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8cdfa13f-4f3a-4e27-8bcd-b4859e0b5555 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '.version_select at 0x7f996d494430>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:24.455874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8cdfa13f-4f3a-4e27-8bcd-b4859e0b5555 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641211602" status: 202 len: 0 microversion: 2.1 time: 0.080905 May 23 20:28:24.456449 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 378/776] 10.222.0.16 () {58 vars in 1217 bytes} [Mon May 23 20:28:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641211602 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:28:24.460436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:24.468119 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d5ebb92f-cdb6-4bb4-b863-675d99f17437 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.153455 May 23 20:28:24.468679 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 399/777] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:24 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:25.205503 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:25.207180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:25.212013 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:25.212990 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:25.220488 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:25.220934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:25.221830 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:25.222453 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:25.365876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:25.373718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-25b84dc8-abd4-4267-b6b1-3bbe594fd82c tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.169037 May 23 20:28:25.374305 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 379/778] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:25 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:25.485413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:25.485971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:25.488414 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:25.493649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:25.498553 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:25.498553 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:25.498553 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:25.627246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:25.634779 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-25a77b09-58b5-40fd-a141-efec64bce18e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.153963 May 23 20:28:25.635333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 400/779] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:25 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:26.391021 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:26.391637 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:26.398878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:26.399331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:26.400096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:26.400536 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:26.530395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:26.537867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b89fe943-1813-4cd3-96c3-1121a2ef97cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.150710 May 23 20:28:26.543090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 380/780] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:26 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:26.657335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:26.657335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:26.660195 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:26.660644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:26.661409 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:26.661842 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:26.789855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:26.797303 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3b927fa1-ca9b-49ee-8865-edfab166798e tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.149020 May 23 20:28:26.797858 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 401/781] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:26 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:27.554109 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:27.554754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:27.561257 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:27.561710 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:27.562501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:27.562943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:27.691116 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:27.698517 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-85ce5c19-a1cd-40e4-888b-02cb2716705a tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.148299 May 23 20:28:27.699199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 381/782] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:27 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:27.726336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:27.726934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:27.733442 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:27.733893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:27.734688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:27.735123 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:27.759251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:28:27.814450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:27.814979 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:27.817861 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:27.821256 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:27.821701 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:27.822555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:27.823053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:27.954925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:27.963074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-41f375ba-75cf-4745-9233-1f6884783dff tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.152471 May 23 20:28:27.963639 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 382/783] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:27 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:28.043143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5b51e23e-e74e-4529-bfbf-bebebd86763b tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "DELETE /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 204 len: 0 microversion: 2.1 time: 0.320298 May 23 20:28:28.043771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 402/784] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:28:27 2022] DELETE /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 20:28:28.051908 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:28.052635 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:28.060091 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.060542 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:28.061307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.061746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:28.189146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:28.197265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0f16eb0e-05dc-413c-aa4a-6a9ef2cc2fa3 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1507 microversion: 2.1 time: 0.149227 May 23 20:28:28.197967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 383/785] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:28 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:28.382300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cf2d53c0-68cc-4ba3-b163-bd826d38c3d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:28.382868 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cf2d53c0-68cc-4ba3-b163-bd826d38c3d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:28.388994 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf2d53c0-68cc-4ba3-b163-bd826d38c3d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.389380 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf2d53c0-68cc-4ba3-b163-bd826d38c3d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:28.390150 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf2d53c0-68cc-4ba3-b163-bd826d38c3d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.390581 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf2d53c0-68cc-4ba3-b163-bd826d38c3d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:28.412776 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cf2d53c0-68cc-4ba3-b163-bd826d38c3d3 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/ips" status: 200 len: 146 microversion: 2.1 time: 0.086268 May 23 20:28:28.413320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 403/786] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:28:28 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:28.715702 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:28.716252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:28.723128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.723569 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:28.724316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.724744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:28.858097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:28.866256 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2a7a5441-ddc9-45f8-ab42-dbfa900f9dca tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.154489 May 23 20:28:28.866939 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 384/787] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:28 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:28.979686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:28.980330 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:28.987583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.988040 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:28.988804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:28.989247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:29.121984 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:29.129426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b39f21a5-dc85-4a25-a0e0-4d96f9674662 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.154144 May 23 20:28:29.129983 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 404/788] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:28 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:29.215609 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:29.216254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:29.223129 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:29.223558 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:29.224277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:29.224709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:29.350574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:29.357978 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dfa3646a-7e7c-4623-a624-39e41cc69b45 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1507 microversion: 2.1 time: 0.146394 May 23 20:28:29.358558 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 385/789] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:29 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:29.884058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:29.884775 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:29.891854 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:29.892300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:29.893066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:29.893546 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:29.991841 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-422a5d50-4a61-43cc-bc7f-dedfc07eddda tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b91d899f-cc98-4a19-ab75-bd87f221569f"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:29.991841 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-422a5d50-4a61-43cc-bc7f-dedfc07eddda tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:29.997267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-422a5d50-4a61-43cc-bc7f-dedfc07eddda tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:29.997733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-422a5d50-4a61-43cc-bc7f-dedfc07eddda tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:29.998506 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-422a5d50-4a61-43cc-bc7f-dedfc07eddda tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:29.998935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-422a5d50-4a61-43cc-bc7f-dedfc07eddda tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:30.024345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:30.033031 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-db50fd17-60cf-4c0c-9ea7-92a6a533a196 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.152981 May 23 20:28:30.033589 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 405/790] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:29 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:30.146082 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:30.146694 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:30.152647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:30.153078 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:30.153836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:30.154298 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:30.281136 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:30.289720 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ca58dda4-72cc-43eb-a2ac-3a855f182add tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.147396 May 23 20:28:30.290661 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 406/791] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:30 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:30.374526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:30.375133 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:30.377057 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:30.381929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:30.382408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:30.383186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:30.383615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:30.512454 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:30.520278 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bb4c2a8b-171b-407d-b6a3-a4fadcda7ca5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1507 microversion: 2.1 time: 0.149454 May 23 20:28:30.520867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 407/792] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:30 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:31.085601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cfa1bf15-9490-4199-978c-c4b79fe3be5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:31.086249 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cfa1bf15-9490-4199-978c-c4b79fe3be5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:31.092108 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cfa1bf15-9490-4199-978c-c4b79fe3be5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.092548 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cfa1bf15-9490-4199-978c-c4b79fe3be5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.093298 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cfa1bf15-9490-4199-978c-c4b79fe3be5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.093725 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cfa1bf15-9490-4199-978c-c4b79fe3be5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.116408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cfa1bf15-9490-4199-978c-c4b79fe3be5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/ips" status: 200 len: 151 microversion: 2.20 time: 0.085834 May 23 20:28:31.116943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 408/793] 10.222.0.16 () {60 vars in 1288 bytes} [Mon May 23 20:28:31 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 23 20:28:31.121295 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:31.122040 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:31.128630 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.132092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.132092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.132092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.134517 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:31.264400 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:31.271967 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-57826d4f-18c5-4062-9b85-703473314068 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.154101 May 23 20:28:31.273969 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 409/794] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:31 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:31.305807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:31.306433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:31.312059 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.312509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.313265 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.313702 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.446264 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:31.454170 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ccfa734c-c12a-4c34-9c65-1650b60010fb tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.151760 May 23 20:28:31.454817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 410/795] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:31 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:31.536705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:31.537319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:31.543642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.543963 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.544739 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:31.545484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:31.758635 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:31.767264 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-99b7b7fa-9d31-4b33-98c3-4b56ff97b181 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1507 microversion: 2.1 time: 0.234530 May 23 20:28:31.767831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 411/796] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:31 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:32.226316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-422a5d50-4a61-43cc-bc7f-dedfc07eddda tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.240298 May 23 20:28:32.227674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 386/797] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:28:29 2022] POST /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments => generated 194 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:28:32.232818 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-621ca2e4-015a-4f02-a4db-3546c0973cb0 req-6f7d6ffa-5e3d-4f9c-aa36-1add6fa09c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "881652d5-5df9-43a8-b417-afe21877e7f2", "name": "network-vif-deleted", "tag": "d0965418-0eb9-41f9-bd9a-a071392128fb"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:32.240020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-621ca2e4-015a-4f02-a4db-3546c0973cb0 req-6f7d6ffa-5e3d-4f9c-aa36-1add6fa09c0a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.240396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-621ca2e4-015a-4f02-a4db-3546c0973cb0 req-6f7d6ffa-5e3d-4f9c-aa36-1add6fa09c0a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.256003 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-621ca2e4-015a-4f02-a4db-3546c0973cb0 req-6f7d6ffa-5e3d-4f9c-aa36-1add6fa09c0a service nova] Creating event network-vif-deleted:d0965418-0eb9-41f9-bd9a-a071392128fb for instance 881652d5-5df9-43a8-b417-afe21877e7f2 on hv-cinder-84301 May 23 20:28:32.262482 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-621ca2e4-015a-4f02-a4db-3546c0973cb0 req-6f7d6ffa-5e3d-4f9c-aa36-1add6fa09c0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096286 May 23 20:28:32.263118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 412/798] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:28:32.289923 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:32.290646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:32.296860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.297302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.298116 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.298630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.444996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:32.462975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5aa67c22-4bb8-4613-9cfb-25bda4d827cf tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.174861 May 23 20:28:32.466778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 387/799] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:32 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:32.472006 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:32.472764 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:32.480217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.481049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.481914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.482386 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.628699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:32.636666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1da48a78-5c0f-49cc-9762-34eb4f195c31 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.169095 May 23 20:28:32.637229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 413/800] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:32 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:32.783489 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:32.784122 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:32.790677 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.791123 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.791888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.792320 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.824143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:32.824844 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:32.825286 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lazy-loading 'fault' on Instance uuid 881652d5-5df9-43a8-b417-afe21877e7f2 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:32.868907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:32.876560 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6b631d87-007e-4721-be6d-b8183edbe83e tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 200 len: 1311 microversion: 2.1 time: 0.097034 May 23 20:28:32.877121 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 388/801] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:32 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:33.228516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:33.229048 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:33.235817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.236394 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.237659 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.238123 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.260137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lazy-loading 'flavor' on Instance uuid cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:33.481691 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:33.482345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:33.488913 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.489360 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.490541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.490541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.619618 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:33.627326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-675aaaca-2640-4451-b817-7140c68b0951 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.149715 May 23 20:28:33.627892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 389/802] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:33 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:33.653617 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:33.654369 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:33.660835 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.668075 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.668075 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.668075 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.680265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:33.743107 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f4722cb2-5058-43bb-b9ba-dd5932f51a0d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/action" status: 202 len: 0 microversion: 2.20 time: 0.518317 May 23 20:28:33.746059 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 414/803] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 20:28:33 2022] POST /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 20:28:33.753090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:33.763433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:33.763433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.763433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.763433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.763838 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.802380 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:33.809979 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4beb5a96-e7bf-4256-9ed6-1340e0576e16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.160052 May 23 20:28:33.810564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 390/804] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:33 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:33.894834 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:33.895588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 881652d5-5df9-43a8-b417-afe21877e7f2] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:33.898229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:33.901709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.902269 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.903199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.903732 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.906076 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:33.907557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:33.908693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bf949b4b-3597-49ab-935f-a2d51bc26560 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.160713 May 23 20:28:33.909242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 415/805] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:33 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:33.918627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] HTTP exception thrown: Instance 881652d5-5df9-43a8-b417-afe21877e7f2 could not be found. May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Request method failure captured: May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 HTTP/1.1 May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-060eSaldOSLPXRVhNUGhvociZGC633JEFPxVVHDtDuTPKx4PMyR1lIM71oxfnHfneq-9jWF2_d1xuS-KO1638uBEGF8IK556x2rqNWNBql86zLjbH3Fh-HCnDw4VyLmnV4oDUnZl2OAfUpH2YPeb_3IpsvknLOlDpldliwLOEWJG8 May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:28:33.920359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02969314f19c4dc182b0dbe76aad9a34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}] May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: feb66e681a894c148e3463ff5a0dd1be May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 881652d5-5df9-43a8-b417-afe21877e7f2 could not be found. May 23 20:28:33.921974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '881652d5-5df9-43a8-b417-afe21877e7f2'} May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 881652d5-5df9-43a8-b417-afe21877e7f2 could not be found. May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:28:33.923953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 881652d5-5df9-43a8-b417-afe21877e7f2 could not be found. May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 881652d5-5df9-43a8-b417-afe21877e7f2 could not be found. May 23 20:28:33.925309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:33.926584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Returning 404 to user: Instance 881652d5-5df9-43a8-b417-afe21877e7f2 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:28:33.926584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-28a4e007-e8e8-4956-810b-797e4648ed1f tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2" status: 404 len: 111 microversion: 2.1 time: 0.031735 May 23 20:28:33.926584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 391/806] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:33 2022] GET /compute/v2.1/servers/881652d5-5df9-43a8-b417-afe21877e7f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 20:28:33.931573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:33.932089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:33.938092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.938533 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.939275 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:33.939704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:33.964567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:28:34.231845 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-52a78223-1e00-4f8b-977c-2ad1e2842a64 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 204 len: 0 microversion: 2.1 time: 0.303626 May 23 20:28:34.232437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 416/807] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:28:33 2022] DELETE /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:28:34.240970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:34.241576 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:34.247713 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.248163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.248918 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.249349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.381785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:34.389933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e6ca3e21-a8fc-4cd1-9c63-c7675336638c tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.153100 May 23 20:28:34.390536 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 392/808] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:34 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:34.644101 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:34.644909 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:34.651499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.651947 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.652713 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.653146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.785692 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:34.793645 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-415ff804-9e0a-4718-8d7c-5733d962951d tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.153720 May 23 20:28:34.794264 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 417/809] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:34 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:34.826045 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:34.826671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:34.833629 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.834105 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.834893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.835339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.927378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:34.928322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:34.933973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.934440 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.935194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:34.935626 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:34.968429 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:34.976460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0e6f05f4-d484-483d-8d87-210fd403266d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.154608 May 23 20:28:34.977015 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 393/810] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:34 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:35.061597 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:35.069639 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:35.072285 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:35.072285 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-01064c32-4d64-488e-9f17-2420b9c5352e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.149745 May 23 20:28:35.072971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 418/811] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:34 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:35.406463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:35.407108 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:35.413717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:35.414211 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:35.414988 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:35.415431 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:35.550285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:35.557798 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-97c81a59-5052-47d8-987e-dd51db6209a9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.155194 May 23 20:28:35.558533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 394/812] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:35 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:35.810931 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:35.811474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:35.818577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:35.819024 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:35.819784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:35.820219 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:35.949634 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:35.957058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0308f680-98d4-438d-a208-0bb380964fe0 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.150024 May 23 20:28:35.957615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 419/813] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:35 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:35.992993 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:35.993606 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:36.000104 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.000557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.001323 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.001762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.091612 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:36.092403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:36.099058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.099577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.100386 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.100886 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.131821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:36.139366 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-eb860f91-3b42-484e-9c5c-25a81a706041 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.150221 May 23 20:28:36.139944 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 395/814] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:35 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:36.228065 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:36.235939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:36.238071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:36.239224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-02daf1b2-239b-44dc-89f4-90a61b18f44c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.151522 May 23 20:28:36.239774 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 420/815] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:36 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:36.575289 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:36.575900 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:36.582403 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.582873 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.583633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.584071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.710509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:36.718500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c64883ed-f7bb-465a-b5fc-5cc7fa1c8ce9 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.146635 May 23 20:28:36.719114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 396/816] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:36 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:36.947601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-ff719116-12ce-4770-b459-3318577d8e5c req-b0651f98-d41c-4eb6-acda-486a436268f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18", "name": "network-vif-plugged", "status": "completed", "tag": "e3fbb816-fd5a-4989-8f75-4be912227768"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:36.960190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ff719116-12ce-4770-b459-3318577d8e5c req-b0651f98-d41c-4eb6-acda-486a436268f3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.960190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ff719116-12ce-4770-b459-3318577d8e5c req-b0651f98-d41c-4eb6-acda-486a436268f3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.968186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-ff719116-12ce-4770-b459-3318577d8e5c req-b0651f98-d41c-4eb6-acda-486a436268f3 service nova] Creating event network-vif-plugged:e3fbb816-fd5a-4989-8f75-4be912227768 for instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 on hv-cinder-84301 May 23 20:28:36.973254 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-ff719116-12ce-4770-b459-3318577d8e5c req-b0651f98-d41c-4eb6-acda-486a436268f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029325 May 23 20:28:36.973839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 421/817] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:36.973986 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:36.974728 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:36.980823 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.981273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:36.982041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:36.982519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:37.116316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:37.124035 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7ca44593-a1d9-44b0-9878-f0190d33a091 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.154062 May 23 20:28:37.124603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 397/818] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:36 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:37.156095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:37.161145 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:37.163526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:37.163972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:37.164724 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:37.165154 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:37.259087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:37.259703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:37.267349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:37.267802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:37.269022 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:37.269616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:37.325603 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:37.333509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-33966151-7837-47e0-9ace-d361f59fa430 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.181514 May 23 20:28:37.334233 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 422/819] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:37 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:37.403746 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:37.417775 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:37.419534 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:37.420700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-799ca980-97b5-48cf-b409-6d2d31f8cd9b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.167223 May 23 20:28:37.421255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 398/820] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:37 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:37.735526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:37.736346 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:37.743563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:37.744015 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:37.744781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:37.745219 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:37.760277 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:37.875663 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:37.883010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e80d534b-5256-4325-ac16-f252a2ec3e63 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1521 microversion: 2.1 time: 0.151321 May 23 20:28:37.883588 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 423/821] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:37 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:38.130717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-37790125-666c-4cd4-82dd-1ff2b20e2c82 req-be99310f-1600-4285-b6ea-3a6cd07c0988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4058a126-dae4-43c7-8270-12ea57ea38c6", "name": "network-vif-deleted", "tag": "7c6e7dea-7110-4e10-8314-3048e5eb1884"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:38.139774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-37790125-666c-4cd4-82dd-1ff2b20e2c82 req-be99310f-1600-4285-b6ea-3a6cd07c0988 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.140235 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-37790125-666c-4cd4-82dd-1ff2b20e2c82 req-be99310f-1600-4285-b6ea-3a6cd07c0988 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.140733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:38.141345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:38.148523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.148973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.149735 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.150203 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.153449 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-37790125-666c-4cd4-82dd-1ff2b20e2c82 req-be99310f-1600-4285-b6ea-3a6cd07c0988 service nova] Creating event network-vif-deleted:7c6e7dea-7110-4e10-8314-3048e5eb1884 for instance 4058a126-dae4-43c7-8270-12ea57ea38c6 on hv-cinder-84301 May 23 20:28:38.158601 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-37790125-666c-4cd4-82dd-1ff2b20e2c82 req-be99310f-1600-4285-b6ea-3a6cd07c0988 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031383 May 23 20:28:38.159769 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 399/822] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:38.277563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:38.285759 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2a378c7c-6766-41b5-800c-c1b7036de6e4 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1575 microversion: 2.1 time: 0.149072 May 23 20:28:38.286333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 424/823] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:38 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:38.353649 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:38.354397 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:38.360781 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.361231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.362275 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.362717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.440222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:38.440803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:38.447476 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.447928 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.448705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.449388 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.522420 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:38.532025 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-38a561fd-573c-4efa-82b5-a91876f2d0cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.182407 May 23 20:28:38.532684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 400/824] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:38 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:38.595239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:38.603353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:38.604867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:38.606076 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c4c3d299-b177-49f4-ac9a-a10391480e36 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.170394 May 23 20:28:38.606865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 425/825] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:38 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:38.899815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:38.900432 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:38.906616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.907070 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.911331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:38.911331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:38.973365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:38.981552 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-858b23a1-b5fc-49ec-81b3-b73defecc2a5 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1307 microversion: 2.1 time: 0.085520 May 23 20:28:38.982155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 401/826] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:38 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1307 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:39.043149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-c8f1d899-7ef4-4188-acd7-c09fff8cefef req-891a279a-2042-4244-a74a-47e7c6df2beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd76191-07fb-44e2-af58-b6a847a04996", "name": "network-vif-plugged", "status": "completed", "tag": "ded069bc-1e0c-448e-8af6-6ea2d76dc8f8"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:39.052023 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-c8f1d899-7ef4-4188-acd7-c09fff8cefef req-891a279a-2042-4244-a74a-47e7c6df2beb service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:39.052464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-c8f1d899-7ef4-4188-acd7-c09fff8cefef req-891a279a-2042-4244-a74a-47e7c6df2beb service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:39.063557 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-c8f1d899-7ef4-4188-acd7-c09fff8cefef req-891a279a-2042-4244-a74a-47e7c6df2beb service nova] Creating event network-vif-plugged:ded069bc-1e0c-448e-8af6-6ea2d76dc8f8 for instance fdd76191-07fb-44e2-af58-b6a847a04996 on hv-cinder-84301 May 23 20:28:39.069365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-c8f1d899-7ef4-4188-acd7-c09fff8cefef req-891a279a-2042-4244-a74a-47e7c6df2beb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085239 May 23 20:28:39.070171 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 426/827] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:28:39.303491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:39.304102 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:39.310518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:39.310976 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:39.311738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:39.312177 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:39.446187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:39.453956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7bb94c70-dfb3-4ff6-b402-accced50af68 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1562 microversion: 2.1 time: 0.155027 May 23 20:28:39.454552 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 402/828] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:39 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:39.549869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:39.550528 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:39.556627 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:39.557071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:39.557889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:39.558362 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:39.623638 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:39.624234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:39.630267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:39.630713 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:39.631462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:39.631916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:39.699344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:39.707788 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-968b2ae1-95c4-47bf-922f-f0fa193949d4 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.162729 May 23 20:28:39.709721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 427/829] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:39 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:39.777527 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:39.787396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:39.788959 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:39.790263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-791c79d5-089c-4174-a77a-ae0ae95169f6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.170494 May 23 20:28:39.790822 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 403/830] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:39 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:39.998594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:39.999198 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:40.005738 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.006231 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.006981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.007408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.040436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.040854 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.041258 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lazy-loading 'fault' on Instance uuid 4058a126-dae4-43c7-8270-12ea57ea38c6 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:40.085460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb66e681a894c148e3463ff5a0dd1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02969314f19c4dc182b0dbe76aad9a34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:40.093367 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1d808166-8263-429c-afa9-21449310cbfa tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 200 len: 1312 microversion: 2.1 time: 0.098400 May 23 20:28:40.094112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 428/831] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:39 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:40.725705 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:40.726352 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:40.732734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.733185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.733979 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.734436 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.805361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3784a00c-8285-490a-b97a-b25968948741 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:40.806396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3784a00c-8285-490a-b97a-b25968948741 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:40.812910 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3784a00c-8285-490a-b97a-b25968948741 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.813349 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3784a00c-8285-490a-b97a-b25968948741 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.814132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3784a00c-8285-490a-b97a-b25968948741 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.814562 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3784a00c-8285-490a-b97a-b25968948741 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.845100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3784a00c-8285-490a-b97a-b25968948741 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 May 23 20:28:40.845664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 429/832] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:40 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:28:40.851070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:40.851444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:40.857231 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.857670 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.858614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.859048 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.869525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:40.877376 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1ea9003b-dd89-4568-be54-81afd2553fb8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1266 microversion: 2.1 time: 0.156524 May 23 20:28:40.877938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 404/833] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:40 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:40.882491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1f8b77b2-21d5-4a2e-8d1d-7a93f5206873 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:40.883122 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1f8b77b2-21d5-4a2e-8d1d-7a93f5206873 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:40.889065 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1f8b77b2-21d5-4a2e-8d1d-7a93f5206873 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.889514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1f8b77b2-21d5-4a2e-8d1d-7a93f5206873 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.890302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1f8b77b2-21d5-4a2e-8d1d-7a93f5206873 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:40.890731 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1f8b77b2-21d5-4a2e-8d1d-7a93f5206873 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:40.919554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1f8b77b2-21d5-4a2e-8d1d-7a93f5206873 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/b91d899f-cc98-4a19-ab75-bd87f221569f" status: 200 len: 194 microversion: 2.1 time: 0.040572 May 23 20:28:40.920457 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 405/834] 10.222.0.16 () {58 vars in 1412 bytes} [Mon May 23 20:28:40 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/b91d899f-cc98-4a19-ab75-bd87f221569f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:40.995790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:41.005430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:41.006995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:41.008181 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-87f76d94-6e99-4b0f-8f82-d8f0c930040a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.160888 May 23 20:28:41.009001 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 430/835] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:40 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:41.110573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:41.111181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] [instance: 4058a126-dae4-43c7-8270-12ea57ea38c6] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:41.117203 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:41.117796 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:41.118441 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:41.118881 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:41.132614 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] HTTP exception thrown: Instance 4058a126-dae4-43c7-8270-12ea57ea38c6 could not be found. May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Request method failure captured: May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 HTTP/1.1 May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-060eSaldOSLPXRVhNUGhvociZGC633JEFPxVVHDtDuTPKx4PMyR1lIM71oxfnHfneq-9jWF2_d1xuS-KO1638uBEGF8IK556x2rqNWNBql86zLjbH3Fh-HCnDw4VyLmnV4oDUnZl2OAfUpH2YPeb_3IpsvknLOlDpldliwLOEWJG8 May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:28:41.134267 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_02969314f19c4dc182b0dbe76aad9a34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/02969314f19c4dc182b0dbe76aad9a34"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/02969314f19c4dc182b0dbe76aad9a34"}]}] May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 02969314f19c4dc182b0dbe76aad9a34 May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-587335690 May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: feb66e681a894c148e3463ff5a0dd1be May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-ServerRescueNegativeTestJSON-587335690-project May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 4058a126-dae4-43c7-8270-12ea57ea38c6 could not be found. May 23 20:28:41.135960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '4058a126-dae4-43c7-8270-12ea57ea38c6'} May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4058a126-dae4-43c7-8270-12ea57ea38c6 could not be found. May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:28:41.137163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4058a126-dae4-43c7-8270-12ea57ea38c6 could not be found. May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4058a126-dae4-43c7-8270-12ea57ea38c6 could not be found. May 23 20:28:41.138814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:28:41.140297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] Returning 404 to user: Instance 4058a126-dae4-43c7-8270-12ea57ea38c6 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:28:41.140297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-37a5541c-77ca-4d3a-8e43-b458d1048896 tempest-ServerRescueNegativeTestJSON-587335690 tempest-ServerRescueNegativeTestJSON-587335690-project] 10.222.0.16 "GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6" status: 404 len: 111 microversion: 2.1 time: 0.029050 May 23 20:28:41.140297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 406/836] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:41 2022] GET /compute/v2.1/servers/4058a126-dae4-43c7-8270-12ea57ea38c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:28:41.894291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:41.894907 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:41.901260 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:41.901705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:41.902503 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:41.902936 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:42.026426 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:42.027745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:42.035623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:42.036073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:42.036915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:42.037375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:42.235445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:42.245100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:42.246860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:42.248339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-624f81ab-193b-4bd4-a2bf-92c9ce8196d0 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.226128 May 23 20:28:42.248825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 407/837] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:42 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:42.271591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:42.279106 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-17df9219-c166-4b82-9aaf-40a20790f360 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1451 microversion: 2.1 time: 0.388834 May 23 20:28:42.279658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 431/838] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:41 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1451 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:42.295401 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:42.296011 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:42.302946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:42.303394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:42.304147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:42.304586 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:42.509465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7396f533-21fc-41a7-884e-d9302c5e9c3d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f257629-d28a-4e40-a95f-f545391f47f7"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:42.510495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7396f533-21fc-41a7-884e-d9302c5e9c3d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:42.514199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:42.518301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7396f533-21fc-41a7-884e-d9302c5e9c3d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:42.519017 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7396f533-21fc-41a7-884e-d9302c5e9c3d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:42.520020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7396f533-21fc-41a7-884e-d9302c5e9c3d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:42.520660 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7396f533-21fc-41a7-884e-d9302c5e9c3d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:42.522704 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cce5e3d2-cd21-465d-88c0-006c7427aa00 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1451 microversion: 2.1 time: 0.231089 May 23 20:28:42.535339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 408/839] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:42 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1451 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:28:43.267317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:43.269039 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:43.276804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:43.280745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:43.280745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:43.280745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:43.292126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:43.338988 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7396f533-21fc-41a7-884e-d9302c5e9c3d tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "POST /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834359 May 23 20:28:43.339960 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 432/840] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:28:42 2022] POST /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:28:43.546802 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:43.555641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:43.557373 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:43.558753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7c36c143-6339-4942-bda5-9e8ba909400e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.296734 May 23 20:28:43.570757 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 409/841] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:43 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:44.578194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:44.579432 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:44.587980 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:44.588576 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:44.589456 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:44.590154 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:44.768917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:44.777933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-e3b9ab45-4a98-4d79-bc70-7653decf77ff req-1f643a6d-2453-402c-86f2-46515743c28c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd76191-07fb-44e2-af58-b6a847a04996", "tag": "ded069bc-1e0c-448e-8af6-6ea2d76dc8f8"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:44.778543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:44.780072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:44.781283 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e0103170-1927-4774-b8f1-540b9f751597 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.207760 May 23 20:28:44.782346 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 433/842] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:44 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:44.799650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-e3b9ab45-4a98-4d79-bc70-7653decf77ff req-1f643a6d-2453-402c-86f2-46515743c28c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:44.800452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-e3b9ab45-4a98-4d79-bc70-7653decf77ff req-1f643a6d-2453-402c-86f2-46515743c28c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:44.812903 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-e3b9ab45-4a98-4d79-bc70-7653decf77ff req-1f643a6d-2453-402c-86f2-46515743c28c service nova] Creating event network-changed:ded069bc-1e0c-448e-8af6-6ea2d76dc8f8 for instance fdd76191-07fb-44e2-af58-b6a847a04996 on hv-cinder-84301 May 23 20:28:44.819142 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-e3b9ab45-4a98-4d79-bc70-7653decf77ff req-1f643a6d-2453-402c-86f2-46515743c28c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045676 May 23 20:28:44.820483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 410/843] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:28:45.803141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:45.803804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:45.811420 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:45.811869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:45.812642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:45.813796 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:45.958040 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:45.967288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:45.968817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:45.969985 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d687b69c-2d37-4613-9319-4dc283c94b5b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.171512 May 23 20:28:45.971493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 434/844] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:45 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:46.990441 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:46.991159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:46.997237 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:46.997682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:46.998460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:46.998891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:47.137253 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:47.145810 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:47.147418 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:47.148612 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-52e5eb06-911a-4291-a13c-2a55b9db339f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.163527 May 23 20:28:47.149158 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 411/845] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:46 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:48.167631 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:48.168232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:48.174792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:48.175229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:48.175972 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:48.176398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:48.309158 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:48.317021 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:48.318538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:48.319676 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0ad76972-9474-4f62-8eb8-0892590b01dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.155892 May 23 20:28:48.320223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 435/846] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:48 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:49.337399 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:49.338128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:49.344578 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:49.345029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:49.345863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:49.346255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:49.657905 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:49.666123 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:49.667610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:49.669096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ea633a2c-5304-4582-87ca-0b4b5da44153 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1744 microversion: 2.20 time: 0.335563 May 23 20:28:49.680482 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 412/847] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:49 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1744 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:50.688067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:50.688683 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:50.695374 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:50.695826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:50.696590 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:50.697028 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:50.847144 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:50.857333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:50.859170 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:50.860629 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4519db7b-0106-490d-a014-6ebf8ab893dd tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1744 microversion: 2.20 time: 0.176419 May 23 20:28:50.872415 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 436/848] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:50 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:51.881788 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:51.882456 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:51.890987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:51.891756 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:51.892869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:51.893311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:51.977570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bf4cde67-7d51-4e23-a07b-584dc25c748e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:51.978614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bf4cde67-7d51-4e23-a07b-584dc25c748e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:51.985585 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf4cde67-7d51-4e23-a07b-584dc25c748e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:51.986329 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf4cde67-7d51-4e23-a07b-584dc25c748e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:51.987105 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf4cde67-7d51-4e23-a07b-584dc25c748e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:51.987535 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bf4cde67-7d51-4e23-a07b-584dc25c748e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:52.020955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bf4cde67-7d51-4e23-a07b-584dc25c748e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047777 May 23 20:28:52.022071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 437/849] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:51 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:52.031887 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:52.040733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:52.042307 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:52.052969 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-471c947e-02c8-4b6f-b2eb-e05c0cf08cd1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1744 microversion: 2.20 time: 0.168115 May 23 20:28:52.052969 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 413/850] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:51 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:52.160505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-701e4ca2-5806-4464-8d44-207bc54e57ca tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:52.161562 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-701e4ca2-5806-4464-8d44-207bc54e57ca tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:52.167598 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-701e4ca2-5806-4464-8d44-207bc54e57ca tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:52.168036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-701e4ca2-5806-4464-8d44-207bc54e57ca tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:52.168782 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-701e4ca2-5806-4464-8d44-207bc54e57ca tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:52.169207 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-701e4ca2-5806-4464-8d44-207bc54e57ca tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:52.197591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-701e4ca2-5806-4464-8d44-207bc54e57ca tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/b91d899f-cc98-4a19-ab75-bd87f221569f" status: 200 len: 194 microversion: 2.1 time: 0.041098 May 23 20:28:52.198361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 438/851] 10.222.0.16 () {58 vars in 1412 bytes} [Mon May 23 20:28:52 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/b91d899f-cc98-4a19-ab75-bd87f221569f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:52.208720 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:52.209293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:52.216410 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:52.217394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:52.218394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:52.218987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:52.307339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lazy-loading 'services' on Instance uuid 22718422-007c-4e56-a5b2-5154cd7ad3b9 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:52.524139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-16029c9b-2515-427e-88a3-bbc373766364 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/b91d899f-cc98-4a19-ab75-bd87f221569f" status: 202 len: 0 microversion: 2.1 time: 0.319762 May 23 20:28:52.527728 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 414/852] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:28:52 2022] DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/b91d899f-cc98-4a19-ab75-bd87f221569f => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:28:53.068741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:53.069348 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:53.081816 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-6c2474a5-00b4-44ee-900e-7b21ee9358bf req-f3d00496-915b-4a06-8568-fdd4d089bfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac", "name": "network-vif-plugged", "status": "completed", "tag": "d964f307-0816-459b-b91f-c56aa300d183"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:53.097004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:53.099308 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:53.105003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-6c2474a5-00b4-44ee-900e-7b21ee9358bf req-f3d00496-915b-4a06-8568-fdd4d089bfc2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:53.105165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:53.105268 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-6c2474a5-00b4-44ee-900e-7b21ee9358bf req-f3d00496-915b-4a06-8568-fdd4d089bfc2 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:53.105371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:53.116110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-6c2474a5-00b4-44ee-900e-7b21ee9358bf req-f3d00496-915b-4a06-8568-fdd4d089bfc2 service nova] Creating event network-vif-plugged:d964f307-0816-459b-b91f-c56aa300d183 for instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac on hv-cinder-84301 May 23 20:28:53.121280 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-6c2474a5-00b4-44ee-900e-7b21ee9358bf req-f3d00496-915b-4a06-8568-fdd4d089bfc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046066 May 23 20:28:53.122983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 415/853] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:53.135398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:53.283018 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:53.292300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:53.294172 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:53.295564 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d200a426-3e83-4484-a159-4f14b436135b tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.230715 May 23 20:28:53.296889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 439/854] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:53 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:53.741022 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-413a584a-872b-4c0b-8c97-7ccfa4121505 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:53.743167 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-413a584a-872b-4c0b-8c97-7ccfa4121505 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:53.754300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-413a584a-872b-4c0b-8c97-7ccfa4121505 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:53.754300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-413a584a-872b-4c0b-8c97-7ccfa4121505 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:53.754300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-413a584a-872b-4c0b-8c97-7ccfa4121505 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:53.754300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-413a584a-872b-4c0b-8c97-7ccfa4121505 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:53.779357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-413a584a-872b-4c0b-8c97-7ccfa4121505 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/ips" status: 200 len: 150 microversion: 2.1 time: 0.260306 May 23 20:28:53.780254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 416/855] 10.222.0.16 () {58 vars in 1247 bytes} [Mon May 23 20:28:53 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/ips => generated 150 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:54.313946 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:54.314599 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:54.321391 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:54.327032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:54.327032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:54.327032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:54.673914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:54.686863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:54.689345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:54.690677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9f12596b-4727-4618-8cec-6598195737e4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.381152 May 23 20:28:54.691426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 440/856] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:54 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:54.763765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bc57042e-cc3f-417b-88ed-84b7234d431e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:54.764291 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bc57042e-cc3f-417b-88ed-84b7234d431e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:54.770928 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc57042e-cc3f-417b-88ed-84b7234d431e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:54.771657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc57042e-cc3f-417b-88ed-84b7234d431e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:54.772472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc57042e-cc3f-417b-88ed-84b7234d431e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:54.773153 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc57042e-cc3f-417b-88ed-84b7234d431e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:54.809539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bc57042e-cc3f-417b-88ed-84b7234d431e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/7f257629-d28a-4e40-a95f-f545391f47f7" status: 200 len: 194 microversion: 2.1 time: 0.049772 May 23 20:28:54.810785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 417/857] 10.222.0.16 () {58 vars in 1412 bytes} [Mon May 23 20:28:54 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/7f257629-d28a-4e40-a95f-f545391f47f7 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:54.820328 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:54.820962 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:54.827674 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:54.828179 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:54.829089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:54.830451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:54.937221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lazy-loading 'services' on Instance uuid 22718422-007c-4e56-a5b2-5154cd7ad3b9 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:28:55.203067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2b49c0c6-ee9a-4aab-8c3f-bcf4bf7374cc tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/7f257629-d28a-4e40-a95f-f545391f47f7" status: 202 len: 0 microversion: 2.1 time: 0.386623 May 23 20:28:55.204202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 441/858] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:28:54 2022] DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments/7f257629-d28a-4e40-a95f-f545391f47f7 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:28:55.534517 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0a8455d2-a0f2-4bc8-8308-3c01bb019727 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cca16b1b-222d-403a-9fa2-a7846531eacf"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:28:55.535588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0a8455d2-a0f2-4bc8-8308-3c01bb019727 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:55.542585 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a8455d2-a0f2-4bc8-8308-3c01bb019727 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:55.543091 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a8455d2-a0f2-4bc8-8308-3c01bb019727 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:55.544120 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a8455d2-a0f2-4bc8-8308-3c01bb019727 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:55.544567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0a8455d2-a0f2-4bc8-8308-3c01bb019727 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:55.711110 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:55.711945 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:55.720673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:55.721130 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:55.721913 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:55.722431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:55.867525 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:55.876306 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:55.877987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:55.879172 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b423318f-805a-432d-ae87-15faf9e5cf66 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.173462 May 23 20:28:55.880279 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 442/859] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:55 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:56.818480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0a8455d2-a0f2-4bc8-8308-3c01bb019727 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "POST /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.287761 May 23 20:28:56.819096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 418/860] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:28:55 2022] POST /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:28:56.899802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:56.901141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:56.909714 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:56.910394 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:56.911388 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:56.911966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:57.106516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:57.115856 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:57.117367 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:57.118667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-db27ad9a-d5e0-4d40-8a4f-a288f9a6f70f tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.222967 May 23 20:28:57.119898 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 443/861] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:56 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:28:57.489614 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a9397ef8-bff4-4b1e-adcd-f2a5c85b4dc0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:57.490801 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a9397ef8-bff4-4b1e-adcd-f2a5c85b4dc0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:57.498263 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a9397ef8-bff4-4b1e-adcd-f2a5c85b4dc0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:57.499046 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a9397ef8-bff4-4b1e-adcd-f2a5c85b4dc0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:57.500027 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a9397ef8-bff4-4b1e-adcd-f2a5c85b4dc0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:57.500652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a9397ef8-bff4-4b1e-adcd-f2a5c85b4dc0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:57.538127 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a9397ef8-bff4-4b1e-adcd-f2a5c85b4dc0 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056792 May 23 20:28:57.539646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 419/862] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:57 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:28:57.672863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1ff750c2-4d5f-4eb2-af82-97fb8c9bb932 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:57.673842 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1ff750c2-4d5f-4eb2-af82-97fb8c9bb932 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:57.690138 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ff750c2-4d5f-4eb2-af82-97fb8c9bb932 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:57.690802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ff750c2-4d5f-4eb2-af82-97fb8c9bb932 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:57.691726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ff750c2-4d5f-4eb2-af82-97fb8c9bb932 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:57.692200 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ff750c2-4d5f-4eb2-af82-97fb8c9bb932 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:57.730856 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1ff750c2-4d5f-4eb2-af82-97fb8c9bb932 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062078 May 23 20:28:57.733765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 444/863] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:28:57 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:28:57.823193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:57.824627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:57.830892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:57.831555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:57.832715 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:57.833309 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:57.859231 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:28:58.137971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:58.139373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:58.149210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:58.149642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:58.150691 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:58.157262 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:58.181825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-c17bb4c3-9ff2-4be8-b92f-4e00cadc6cba tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 204 len: 0 microversion: 2.1 time: 0.354919 May 23 20:28:58.181825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 420/864] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:28:57 2022] DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:28:58.184892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:58.185586 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:58.188762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:28:58.197734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:58.199645 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:58.207415 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:58.209367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:58.310262 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:58.325935 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:58.327953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:58.332806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ff527626-3d68-4c51-b007-1fdd67411c72 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.198587 May 23 20:28:58.344751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 445/865] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:58 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:58.410404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:58.429718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b61f4c85-f73c-4914-83c1-0eabc556945e tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1675 microversion: 2.1 time: 0.249209 May 23 20:28:58.430999 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 421/866] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:58 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:28:59.351715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:59.352363 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:59.359393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:59.359844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:59.360650 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:59.361072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:59.448510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:28:59.449369 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:28:59.455904 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:59.456424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:59.457241 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:28:59.457711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:28:59.499947 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:59.508917 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:59.510542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:59.511692 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-10302b7d-0049-4e28-8b99-f4c54fd075bf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.164227 May 23 20:28:59.512312 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 446/867] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:28:59 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:28:59.612810 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:28:59.620844 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b4735d93-989b-480b-8b8d-a51c21e3d7ea tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1675 microversion: 2.1 time: 0.176153 May 23 20:28:59.621407 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 422/868] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:28:59 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:29:00.533240 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:00.534625 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:00.544887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:00.549221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:00.549679 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:00.550979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:00.552477 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:00.638703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:00.639306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:00.648223 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:00.648670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:00.649440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:00.649915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:00.725518 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:00.734373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:00.735794 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:00.739771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8d62afb3-e091-4356-8adf-e5d39128c905 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.211221 May 23 20:29:00.747558 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 447/869] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:00 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:00.889200 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:00.892586 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:00.897103 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fadd0106-f79c-46cd-824e-d0ed6fdd8173 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1675 microversion: 2.1 time: 0.262022 May 23 20:29:00.906938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 423/870] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:00 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:29:01.452338 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-fba50cf0-a656-41ad-b05d-df293d73cdea req-81dd785b-f0d4-4b45-a579-de610d55c256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22718422-007c-4e56-a5b2-5154cd7ad3b9", "name": "network-vif-deleted", "tag": "9f6f0b95-22e5-471b-aabe-b625aff9995f"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:01.471845 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-fba50cf0-a656-41ad-b05d-df293d73cdea req-81dd785b-f0d4-4b45-a579-de610d55c256 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:01.478049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-fba50cf0-a656-41ad-b05d-df293d73cdea req-81dd785b-f0d4-4b45-a579-de610d55c256 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:01.503499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-fba50cf0-a656-41ad-b05d-df293d73cdea req-81dd785b-f0d4-4b45-a579-de610d55c256 service nova] Creating event network-vif-deleted:9f6f0b95-22e5-471b-aabe-b625aff9995f for instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 on hv-cinder-84301 May 23 20:29:01.515744 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-fba50cf0-a656-41ad-b05d-df293d73cdea req-81dd785b-f0d4-4b45-a579-de610d55c256 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067135 May 23 20:29:01.520874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 448/871] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:29:01.767699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:01.769362 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:01.781634 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:01.794872 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:01.798608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:01.807557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:01.915015 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:01.915806 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:01.924397 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:01.927424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:01.929217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:01.931042 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:01.985968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:01.986534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:01.987055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lazy-loading 'fault' on Instance uuid 22718422-007c-4e56-a5b2-5154cd7ad3b9 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:29:02.028110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:02.034832 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a19c51d287046578e9e4016784dad8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39849cec37754352a6822cd57277b954', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:02.039290 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:02.041240 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:02.042562 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d3da0fef-bd6e-4802-beb4-8d6579e6d510 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.288330 May 23 20:29:02.043883 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-01bb48ca-c3a7-41bd-baa6-063a8abd1f9f tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 200 len: 1328 microversion: 2.1 time: 0.133045 May 23 20:29:02.053888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 449/872] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:01 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 1328 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:02.055383 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 424/873] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:01 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:03.061914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:03.062505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:03.066149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:03.066582 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:03.069504 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:03.069954 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:03.070743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:03.071175 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:03.073235 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:03.074218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:03.075057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:03.075497 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:03.090639 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] HTTP exception thrown: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Request method failure captured: May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 HTTP/1.1 May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-0qg1Ta5sVwWKUQUvnkPGHyRxqDNvqxOKmXsD2-1-suiVUKkqNd8tDy4suEEUcEt-aBnlojt1Z_bQW1sgSjFLicaZtpz7-8n8g2Sh9CRjAlP74vz4jM2abYXbmAZ2T154mardew7L5BEc8oDy4IJuTXtvitFRZNxCGo-1F5DeKRdVU May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:29:03.092510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39849cec37754352a6822cd57277b954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39849cec37754352a6822cd57277b954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}] May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 0a19c51d287046578e9e4016784dad8f May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:03.094218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '22718422-007c-4e56-a5b2-5154cd7ad3b9'} May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:03.095086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:03.096417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:03.097752 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Returning 404 to user: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:03.097752 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-919185bc-f472-40ee-a345-774b716726cd tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 404 len: 111 microversion: 2.1 time: 0.032727 May 23 20:29:03.097752 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 425/874] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:03 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 20:29:03.103512 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8701a92e-7827-4b1c-86c7-a460cf65a21b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '.version_select at 0x7f996d3fa9d0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:03.221780 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:03.230673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:03.232313 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:03.233603 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-25711782-6ecc-4461-99da-4391b75407ab tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.175779 May 23 20:29:03.234252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 450/875] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:03 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:03.404477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8701a92e-7827-4b1c-86c7-a460cf65a21b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614999825" status: 202 len: 0 microversion: 2.1 time: 0.304508 May 23 20:29:03.421986 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 426/876] 10.222.0.16 () {58 vars in 1220 bytes} [Mon May 23 20:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614999825 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:29:04.256453 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:04.257204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:04.264084 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:04.264727 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:04.265697 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:04.266344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:04.503232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:04.513490 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:04.515221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:04.516654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8bcc9dd8-7dcc-4ea2-b4f2-01af0b437786 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1739 microversion: 2.20 time: 0.265378 May 23 20:29:04.517285 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 451/877] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:04 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:29:04.728860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:04.729388 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:04.736270 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:04.736859 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:04.737622 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:04.738149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:04.825332 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lazy-loading 'services' on Instance uuid 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:29:05.053393 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-602970e0-c137-40ad-a19c-efff86eb0f89 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments/cca16b1b-222d-403a-9fa2-a7846531eacf" status: 202 len: 0 microversion: 2.1 time: 0.328878 May 23 20:29:05.054477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 427/878] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:29:04 2022] DELETE /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments/cca16b1b-222d-403a-9fa2-a7846531eacf => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:29:05.063133 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e6b1b1aa-398d-47f6-ac00-a1f9c36a279f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:05.064110 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e6b1b1aa-398d-47f6-ac00-a1f9c36a279f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:05.070204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e6b1b1aa-398d-47f6-ac00-a1f9c36a279f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:05.070662 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e6b1b1aa-398d-47f6-ac00-a1f9c36a279f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:05.071468 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e6b1b1aa-398d-47f6-ac00-a1f9c36a279f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:05.071901 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e6b1b1aa-398d-47f6-ac00-a1f9c36a279f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:05.104272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e6b1b1aa-398d-47f6-ac00-a1f9c36a279f tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 May 23 20:29:05.104956 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 452/879] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:29:05 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:29:05.540442 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:05.541138 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:05.547433 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:05.547927 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:05.548681 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:05.549119 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:05.685381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:05.695405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:05.697156 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:05.698348 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-db803996-00bc-48d9-8c40-cde75565236e tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1721 microversion: 2.20 time: 0.162275 May 23 20:29:05.699163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 428/880] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:05 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:06.117824 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3bf3a8a9-dba7-4901-a4aa-3636e5e8e62e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:06.118820 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3bf3a8a9-dba7-4901-a4aa-3636e5e8e62e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:06.128766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3bf3a8a9-dba7-4901-a4aa-3636e5e8e62e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:06.128766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3bf3a8a9-dba7-4901-a4aa-3636e5e8e62e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:06.128766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3bf3a8a9-dba7-4901-a4aa-3636e5e8e62e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:06.128766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3bf3a8a9-dba7-4901-a4aa-3636e5e8e62e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:06.157520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3bf3a8a9-dba7-4901-a4aa-3636e5e8e62e tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 May 23 20:29:06.162839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 453/881] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:29:06 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:29:06.719036 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:06.719627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:06.726497 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:06.728709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:06.728709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:06.728709 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:06.860765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:06.866153 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:06.867821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:06.873041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e2b60540-cb0b-42b8-8f94-842d7af5d71a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1721 microversion: 2.20 time: 0.154003 May 23 20:29:06.873041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 429/882] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:06 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:07.131184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:07.131712 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:07.138257 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.138694 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:07.139452 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.139898 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:07.153920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] HTTP exception thrown: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Request method failure captured: May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 HTTP/1.1 May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0qg1Ta5sVwWKUQUvnkPGHyRxqDNvqxOKmXsD2-1-suiVUKkqNd8tDy4suEEUcEt-aBnlojt1Z_bQW1sgSjFLicaZtpz7-8n8g2Sh9CRjAlP74vz4jM2abYXbmAZ2T154mardew7L5BEc8oDy4IJuTXtvitFRZNxCGo-1F5DeKRdVU May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:07.155686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39849cec37754352a6822cd57277b954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39849cec37754352a6822cd57277b954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}] May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 0a19c51d287046578e9e4016784dad8f May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.157221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '22718422-007c-4e56-a5b2-5154cd7ad3b9'} May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:07.158129 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.159561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.161188 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Returning 404 to user: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:07.161188 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ab471398-4062-4953-b34b-1f0d87097432 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 404 len: 111 microversion: 2.1 time: 0.030227 May 23 20:29:07.161188 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 454/883] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:29:07 2022] DELETE /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:07.168955 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f5f4dde5-42db-42c5-a0a7-9301fa50d9be tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:07.169878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f5f4dde5-42db-42c5-a0a7-9301fa50d9be tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:07.170891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:07.171532 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 22718422-007c-4e56-a5b2-5154cd7ad3b9] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:07.175910 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5f4dde5-42db-42c5-a0a7-9301fa50d9be tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.176854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5f4dde5-42db-42c5-a0a7-9301fa50d9be tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:07.177659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5f4dde5-42db-42c5-a0a7-9301fa50d9be tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.178150 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f5f4dde5-42db-42c5-a0a7-9301fa50d9be tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:07.178284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.178757 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:07.182191 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.182191 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:07.196606 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] HTTP exception thrown: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Request method failure captured: May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 HTTP/1.1 May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0qg1Ta5sVwWKUQUvnkPGHyRxqDNvqxOKmXsD2-1-suiVUKkqNd8tDy4suEEUcEt-aBnlojt1Z_bQW1sgSjFLicaZtpz7-8n8g2Sh9CRjAlP74vz4jM2abYXbmAZ2T154mardew7L5BEc8oDy4IJuTXtvitFRZNxCGo-1F5DeKRdVU May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:07.196927 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39849cec37754352a6822cd57277b954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39849cec37754352a6822cd57277b954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}] May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 0a19c51d287046578e9e4016784dad8f May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.198871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '22718422-007c-4e56-a5b2-5154cd7ad3b9'} May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:07.199719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. May 23 20:29:07.201009 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:07.202607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Returning 404 to user: Instance 22718422-007c-4e56-a5b2-5154cd7ad3b9 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:07.202607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-61ed4d7b-bd9c-4764-ac14-c2ea6462fe1b tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9" status: 404 len: 111 microversion: 2.1 time: 0.031291 May 23 20:29:07.202607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 455/884] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:07 2022] GET /compute/v2.1/servers/22718422-007c-4e56-a5b2-5154cd7ad3b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:07.216994 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f5f4dde5-42db-42c5-a0a7-9301fa50d9be tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051818 May 23 20:29:07.217574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 430/885] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:29:07 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:29:07.887217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:07.887743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:07.894260 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.895194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:07.895996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:07.896430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.044865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:08.047310 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:08.053830 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:08.055378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:08.056563 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c24499b3-4eae-45e2-a6cb-f815bee69611 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1721 microversion: 2.20 time: 0.173503 May 23 20:29:08.057095 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 456/886] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:07 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:08.231700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-588f80ce-e772-41d7-bd00-1835467d81db tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:08.232631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-588f80ce-e772-41d7-bd00-1835467d81db tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:08.239725 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-588f80ce-e772-41d7-bd00-1835467d81db tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.241139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-588f80ce-e772-41d7-bd00-1835467d81db tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.241139 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-588f80ce-e772-41d7-bd00-1835467d81db tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.241360 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-588f80ce-e772-41d7-bd00-1835467d81db tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.271679 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-588f80ce-e772-41d7-bd00-1835467d81db tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045492 May 23 20:29:08.272890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 431/887] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:29:08 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:29:08.336971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:08.338039 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:08.345355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.345803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.346635 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.347064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.373098 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:29:08.424711 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:08.426008 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:08.433321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.433845 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.434924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.435302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.451038 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] HTTP exception thrown: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Request method failure captured: May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: DELETE /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 HTTP/1.1 May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-0qg1Ta5sVwWKUQUvnkPGHyRxqDNvqxOKmXsD2-1-suiVUKkqNd8tDy4suEEUcEt-aBnlojt1Z_bQW1sgSjFLicaZtpz7-8n8g2Sh9CRjAlP74vz4jM2abYXbmAZ2T154mardew7L5BEc8oDy4IJuTXtvitFRZNxCGo-1F5DeKRdVU May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:29:08.452883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39849cec37754352a6822cd57277b954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39849cec37754352a6822cd57277b954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}] May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 0a19c51d287046578e9e4016784dad8f May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.454626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '14f258da-266e-4cb0-8c76-5a3329d1fdc5'} May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:08.455575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.458067 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.459642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Returning 404 to user: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:08.459642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fe890cb1-9017-4e89-bd57-2035547b6ca8 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "DELETE /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 404 len: 111 microversion: 2.1 time: 0.035185 May 23 20:29:08.459642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 432/888] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:29:08 2022] DELETE /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 20:29:08.465559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:08.466293 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] [instance: 14f258da-266e-4cb0-8c76-5a3329d1fdc5] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:08.472637 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.473213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.474075 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.474577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.489852 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] HTTP exception thrown: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Request method failure captured: May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 HTTP/1.1 May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-0qg1Ta5sVwWKUQUvnkPGHyRxqDNvqxOKmXsD2-1-suiVUKkqNd8tDy4suEEUcEt-aBnlojt1Z_bQW1sgSjFLicaZtpz7-8n8g2Sh9CRjAlP74vz4jM2abYXbmAZ2T154mardew7L5BEc8oDy4IJuTXtvitFRZNxCGo-1F5DeKRdVU May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:29:08.491507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_39849cec37754352a6822cd57277b954", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/39849cec37754352a6822cd57277b954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/39849cec37754352a6822cd57277b954"}]}] May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 39849cec37754352a6822cd57277b954 May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499146306 May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 0a19c51d287046578e9e4016784dad8f May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeTestJSON-1499146306-project May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.493181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '14f258da-266e-4cb0-8c76-5a3329d1fdc5'} May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:08.494368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. May 23 20:29:08.495867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:08.497146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] Returning 404 to user: Instance 14f258da-266e-4cb0-8c76-5a3329d1fdc5 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:08.497146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-74442c1f-dfb1-44b7-96f6-c7e9a54e9f53 tempest-AttachVolumeTestJSON-1499146306 tempest-AttachVolumeTestJSON-1499146306-project] 10.222.0.16 "GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5" status: 404 len: 111 microversion: 2.1 time: 0.032346 May 23 20:29:08.497146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 433/889] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:08 2022] GET /compute/v2.1/servers/14f258da-266e-4cb0-8c76-5a3329d1fdc5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:08.676710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-98171e0f-33c0-4902-8512-714a1826dafb tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 204 len: 0 microversion: 2.1 time: 0.338969 May 23 20:29:08.676710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 457/890] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:29:08 2022] DELETE /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:29:08.681198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:08.681823 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:08.688196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.688649 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:08.689415 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:08.689853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:09.008185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:09.023015 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-53aaf7a9-6c95-4017-98da-f398fae89ace tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1682 microversion: 2.1 time: 0.345606 May 23 20:29:09.036514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 434/891] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:08 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1682 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:09.077288 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-76035c33-1904-47f0-98b4-ce3ca9f34932 req-9b406fce-3092-4d82-a8fe-f40fe74ad4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac", "name": "network-vif-unplugged", "status": "completed", "tag": "d964f307-0816-459b-b91f-c56aa300d183"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:09.079141 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:09.080008 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:09.091112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-76035c33-1904-47f0-98b4-ce3ca9f34932 req-9b406fce-3092-4d82-a8fe-f40fe74ad4f0 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:09.091987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-76035c33-1904-47f0-98b4-ce3ca9f34932 req-9b406fce-3092-4d82-a8fe-f40fe74ad4f0 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:09.092135 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:09.092564 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:09.094685 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:09.098473 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:09.106603 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.compute.server_external_events [req-76035c33-1904-47f0-98b4-ce3ca9f34932 req-9b406fce-3092-4d82-a8fe-f40fe74ad4f0 service nova] Unable to find a host for instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac. Dropping event network-vif-unplugged {{(pid=118170) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 23 20:29:09.107678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-76035c33-1904-47f0-98b4-ce3ca9f34932 req-9b406fce-3092-4d82-a8fe-f40fe74ad4f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040121 May 23 20:29:09.109254 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 458/892] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 23 20:29:09.318246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:09.326598 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:09.328340 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:09.329512 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bb49270c-aff1-4584-b877-812d8ebf7443 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1664 microversion: 2.20 time: 0.258536 May 23 20:29:09.330064 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 435/893] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:09 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1664 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:29:09.347309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b7addfee-8973-4ddc-8414-92c8b74c0c88 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbcfc430-650e-4efc-800d-cc086621bf50"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:09.349693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b7addfee-8973-4ddc-8414-92c8b74c0c88 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:09.356353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7addfee-8973-4ddc-8414-92c8b74c0c88 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:09.356803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7addfee-8973-4ddc-8414-92c8b74c0c88 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:09.357573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7addfee-8973-4ddc-8414-92c8b74c0c88 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:09.358140 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b7addfee-8973-4ddc-8414-92c8b74c0c88 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:10.047026 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:10.049408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:10.055782 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:10.056435 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:10.057336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:10.057925 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:10.284072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:10.292417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ff66e054-7fe5-4e4a-8e5a-72526c0c5b21 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1682 microversion: 2.1 time: 0.251444 May 23 20:29:10.293656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 436/894] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:10 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1682 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:29:10.340987 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b7addfee-8973-4ddc-8414-92c8b74c0c88 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.996347 May 23 20:29:10.341626 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 459/895] 10.222.0.16 () {62 vars in 1363 bytes} [Mon May 23 20:29:09 2022] POST /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-volume_attachments => generated 188 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 23 20:29:10.502403 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bc62caa6-670e-40d8-bc8f-323f56a16b51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:10.503512 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bc62caa6-670e-40d8-bc8f-323f56a16b51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:10.510494 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc62caa6-670e-40d8-bc8f-323f56a16b51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:10.511129 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc62caa6-670e-40d8-bc8f-323f56a16b51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:10.512126 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc62caa6-670e-40d8-bc8f-323f56a16b51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:10.513377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bc62caa6-670e-40d8-bc8f-323f56a16b51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:11.226879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bc62caa6-670e-40d8-bc8f-323f56a16b51 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-volume_attachments/fbcfc430-650e-4efc-800d-cc086621bf50" status: 202 len: 0 microversion: 2.20 time: 0.727996 May 23 20:29:11.228943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 437/896] 10.222.0.16 () {60 vars in 1456 bytes} [Mon May 23 20:29:10 2022] DELETE /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-volume_attachments/fbcfc430-650e-4efc-800d-cc086621bf50 => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 20:29:11.303303 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1b2e09d8-4475-4a1d-82e1-2d63f8526b62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:11.304540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1b2e09d8-4475-4a1d-82e1-2d63f8526b62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:11.311588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:11.313394 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:11.330491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b2e09d8-4475-4a1d-82e1-2d63f8526b62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:11.331310 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:11.332021 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:11.333943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:11.334521 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b2e09d8-4475-4a1d-82e1-2d63f8526b62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:11.335798 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:11.336178 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b2e09d8-4475-4a1d-82e1-2d63f8526b62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:11.337804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1b2e09d8-4475-4a1d-82e1-2d63f8526b62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:11.479372 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:11.487319 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-45256177-df4f-4ac6-a41e-32daf9893c1c tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1614 microversion: 2.1 time: 0.179501 May 23 20:29:11.487919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 438/897] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:11 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1614 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:11.601118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1b2e09d8-4475-4a1d-82e1-2d63f8526b62 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "POST /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/action" status: 202 len: 0 microversion: 2.20 time: 0.301971 May 23 20:29:11.602096 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 460/898] 10.222.0.16 () {62 vars in 1318 bytes} [Mon May 23 20:29:11 2022] POST /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 23 20:29:11.610063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:11.610657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:11.617282 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:11.617705 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:11.618517 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:11.618953 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:12.262921 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-3d8639d6-c4ec-4f45-a5c7-19dad7be42ae req-869a9b18-f8af-4dd8-a585-0142c8a49a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca0fa62-1631-4060-a2be-7f7fc3759ed1", "name": "network-vif-deleted", "tag": "b48e4170-0403-4340-9bca-730f726da90b"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:12.272222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-3d8639d6-c4ec-4f45-a5c7-19dad7be42ae req-869a9b18-f8af-4dd8-a585-0142c8a49a6c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:12.272804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-3d8639d6-c4ec-4f45-a5c7-19dad7be42ae req-869a9b18-f8af-4dd8-a585-0142c8a49a6c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:12.293056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-3d8639d6-c4ec-4f45-a5c7-19dad7be42ae req-869a9b18-f8af-4dd8-a585-0142c8a49a6c service nova] Creating event network-vif-deleted:b48e4170-0403-4340-9bca-730f726da90b for instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 on hv-cinder-84301 May 23 20:29:12.336234 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-3d8639d6-c4ec-4f45-a5c7-19dad7be42ae req-869a9b18-f8af-4dd8-a585-0142c8a49a6c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071353 May 23 20:29:12.337056 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:12.337406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 461/899] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:29:12.349657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:12.354936 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:12.358146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7c819489-25bc-41c6-82c7-5e8e657598e1 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1672 microversion: 2.20 time: 0.751125 May 23 20:29:12.367422 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 439/900] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:11 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1672 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:12.506872 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:12.507791 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:12.519410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:12.523381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:12.524884 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:12.525554 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:12.618657 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:12.619397 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:12.619867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lazy-loading 'fault' on Instance uuid 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:29:12.692401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '954933c1cb0249c2a86b309b6f8a334c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1d9be9203346cd8cf364305116abf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:12.700904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-328e8855-d6a4-471a-9605-7a4bce9fae33 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 200 len: 1331 microversion: 2.1 time: 0.199615 May 23 20:29:12.701752 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 462/901] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:12 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 1331 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:13.385380 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:13.386707 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:13.398538 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:13.399379 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:13.400514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:13.401107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:13.463007 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:13.610685 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:13.624519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:13.627217 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:13.629198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-acb26d15-e946-41b9-8bb8-7f4ec04d11d6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1672 microversion: 2.20 time: 0.255582 May 23 20:29:13.634761 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 440/902] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:13 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1672 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:13.719082 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:13.719705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:13.728744 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:13.729440 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:13.730577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:13.731305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:13.747571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 HTTP/1.1 May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:13.749652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:13.751319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '0ca0fa62-1631-4060-a2be-7f7fc3759ed1'} May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:13.752392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:13.753829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:13.755999 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:13.756864 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e34c4f31-6aae-4a09-9e0d-7595c3f67871 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 404 len: 111 microversion: 2.1 time: 0.041903 May 23 20:29:13.757423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 463/903] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:13 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:13.765956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-de57523b-6481-41ac-9b1c-6b8436635169 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '.version_select at 0x7f996d52e1f0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:13.832832 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-de57523b-6481-41ac-9b1c-6b8436635169 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-336624922" status: 202 len: 0 microversion: 2.1 time: 0.070696 May 23 20:29:13.833418 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 441/904] 10.222.0.16 () {58 vars in 1217 bytes} [Mon May 23 20:29:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-336624922 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:29:14.650482 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:14.651092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:14.657904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:14.658951 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:14.660297 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:14.660901 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:14.815081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:14.828461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:14.831492 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:14.832262 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4921bc0f-f56f-4196-ba9f-c8446b253aa5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.185388 May 23 20:29:14.833493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 464/905] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:14 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:29:15.855240 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:15.856029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:15.862582 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:15.863300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:15.865034 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:15.865889 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:15.905678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:15.906333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:15.912899 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:15.913344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:15.914136 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:15.914572 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:15.938357 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 HTTP/1.1 May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:15.939825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:15.941213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '0ca0fa62-1631-4060-a2be-7f7fc3759ed1'} May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:15.942540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:15.943841 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:15.945299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:15.945299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d618737e-7dc4-4c54-94d2-79e2763abd5d tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 404 len: 111 microversion: 2.1 time: 0.042055 May 23 20:29:15.949372 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 465/906] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:29:15 2022] DELETE /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:15.955282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:15.956810 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 0ca0fa62-1631-4060-a2be-7f7fc3759ed1] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:15.967520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:15.968256 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:15.969316 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:15.969923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:15.998155 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 HTTP/1.1 May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:16.001000 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:16.011044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '0ca0fa62-1631-4060-a2be-7f7fc3759ed1'} May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:16.012619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. May 23 20:29:16.014611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:16.017507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 0ca0fa62-1631-4060-a2be-7f7fc3759ed1 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:16.017507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a8384f36-de77-4f7b-a9fe-f39b1838502a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1" status: 404 len: 111 microversion: 2.1 time: 0.051834 May 23 20:29:16.017507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 466/907] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:15 2022] GET /compute/v2.1/servers/0ca0fa62-1631-4060-a2be-7f7fc3759ed1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:16.048434 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:16.058160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:16.060005 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:16.061417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f0a83887-dae2-4c3c-939d-6eabdf54f261 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.210618 May 23 20:29:16.074180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 442/908] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:15 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:17.084391 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:17.085293 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:17.093952 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.094434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.098370 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.098939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.280365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:17.293252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:17.294829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:17.296185 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ba18e7e9-5575-497c-ac8b-03d9051e63f8 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.216606 May 23 20:29:17.296740 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 467/909] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:17 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:17.362584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:17.363107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:17.375764 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.376265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.381185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.382036 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.407280 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: DELETE /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 HTTP/1.1 May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:29:17.409054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.410474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': 'c8b5ec55-f363-4dd6-9d30-536d50973c81'} May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:17.411345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.413196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.415161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:17.415161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-42b2278c-e928-40a2-a745-546f41f16d42 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 404 len: 111 microversion: 2.1 time: 0.052269 May 23 20:29:17.415161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 443/910] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:29:17 2022] DELETE /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:17.421015 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:17.421846 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: c8b5ec55-f363-4dd6-9d30-536d50973c81] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:17.428292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.428740 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.430919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.430919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.445632 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 HTTP/1.1 May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:17.447750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.449423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'c8b5ec55-f363-4dd6-9d30-536d50973c81'} May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:17.453905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. May 23 20:29:17.455224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.456320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance c8b5ec55-f363-4dd6-9d30-536d50973c81 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:17.456320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c717e36d-3d51-45b7-b502-6b8c8c4b6356 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81" status: 404 len: 111 microversion: 2.1 time: 0.035183 May 23 20:29:17.456320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 468/911] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:17 2022] GET /compute/v2.1/servers/c8b5ec55-f363-4dd6-9d30-536d50973c81 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:17.461751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:17.462395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:17.468780 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.469212 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.474577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.476087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.494116 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: DELETE /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 HTTP/1.1 May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:29:17.495893 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.497653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '51c2e8cd-3178-4528-b5b1-db0638467714'} May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:17.498463 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.500479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:17.505765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:17.507202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cae88abc-9749-4a0f-b7b8-7870abb6e1f1 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 404 len: 111 microversion: 2.1 time: 0.050118 May 23 20:29:17.508265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 444/912] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:29:17 2022] DELETE /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:17.519066 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:17.520904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 51c2e8cd-3178-4528-b5b1-db0638467714] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:17.532424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.534417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.534923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:17.535729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:17.559539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 HTTP/1.1 May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:17.573981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.575336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '51c2e8cd-3178-4528-b5b1-db0638467714'} May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:17.576090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. May 23 20:29:17.577337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:17.578682 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 51c2e8cd-3178-4528-b5b1-db0638467714 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:17.578682 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0cbb0115-74e8-4932-8d20-6d54e4f92c1a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714" status: 404 len: 111 microversion: 2.1 time: 0.062277 May 23 20:29:17.580317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 469/913] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:17 2022] GET /compute/v2.1/servers/51c2e8cd-3178-4528-b5b1-db0638467714 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:18.316356 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:18.318700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:18.324688 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:18.325390 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:18.326656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:18.327254 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:18.491145 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:18.500181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:18.502202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:18.503653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-650e1c0d-fd74-40e4-a5b4-2c7d15416be5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.191962 May 23 20:29:18.504525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 445/914] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:18 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:18.873401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:18.873991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:18.881615 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:18.882268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:18.883182 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:18.883832 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:18.901493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 HTTP/1.1 May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:29:18.903849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.905919 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '81e99c75-f555-4442-9cb8-9b296d90b049'} May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:18.906996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.908431 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:29:18.911140 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:18.912177 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6ca42758-d6ae-4677-ab34-eb9dfaa4388a tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 404 len: 111 microversion: 2.1 time: 0.042665 May 23 20:29:18.912770 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 470/915] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:29:18 2022] DELETE /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:18.929881 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:18.930536 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] [instance: 81e99c75-f555-4442-9cb8-9b296d90b049] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:18.937019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:18.940128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:18.940128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:18.940524 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:18.973073 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] HTTP exception thrown: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Request method failure captured: May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 HTTP/1.1 May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-0yRyxDGsLE--2UL0v437CojUH7BZTaWa5WAqu8Agiapdchi67KjfWzXOFGmVMcrQj3NwOegdlrhq7bn5NXcFS8ivsIFmwee26MqcQ6zH0FtxWEFQmv4OEqSNuUYQtxg50yBneAZUfGnWo9ebJpwL4tB-4L-FCphV3TZ9AOcH_gMWQ May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:29:18.974648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb1d9be9203346cd8cf364305116abf1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb1d9be9203346cd8cf364305116abf1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb1d9be9203346cd8cf364305116abf1"}]}] May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: cb1d9be9203346cd8cf364305116abf1 May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-897077377 May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 954933c1cb0249c2a86b309b6f8a334c May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeNegativeTest-897077377-project May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.976082 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '81e99c75-f555-4442-9cb8-9b296d90b049'} May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:29:18.976906 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. May 23 20:29:18.978924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:29:18.980850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] Returning 404 to user: Instance 81e99c75-f555-4442-9cb8-9b296d90b049 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:29:18.980850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d1937eb3-6442-4408-a310-b679d7dfc847 tempest-AttachVolumeNegativeTest-897077377 tempest-AttachVolumeNegativeTest-897077377-project] 10.222.0.16 "GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049" status: 404 len: 111 microversion: 2.1 time: 0.058990 May 23 20:29:18.980850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 446/916] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:18 2022] GET /compute/v2.1/servers/81e99c75-f555-4442-9cb8-9b296d90b049 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:29:19.523716 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:19.524584 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:19.534875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:19.536246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:19.537410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:19.538387 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:19.785898 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:19.795918 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:19.798143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:19.811405 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e26c728e-f3d0-41d2-bf73-3904b39b4bbb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.292205 May 23 20:29:19.818799 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 471/917] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:19 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:20.845596 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:20.846668 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:20.861773 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:20.862509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:20.865301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:20.865301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:21.062778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:21.080478 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:21.085899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:21.094350 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-96445bc6-6553-45f0-a0d6-ac2b2c6ef101 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.245450 May 23 20:29:21.095025 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 447/918] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:20 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:22.114426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:22.114426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:22.128409 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:22.129686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:22.130721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:22.131359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:22.439774 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:22.449583 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:22.451121 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:22.463832 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f694ba3c-0072-4cbe-85eb-2f00a591cdf4 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.354085 May 23 20:29:22.464894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 472/919] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:22 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:23.484165 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:23.485405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:23.498315 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:23.502062 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:23.503343 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:23.507551 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:23.911860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:23.926446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:23.928325 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:23.929672 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ea24b3cb-3d66-4cfa-9a5b-e142a3143163 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.450240 May 23 20:29:23.938456 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 448/920] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:23 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:24.947980 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:24.948899 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:24.956177 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:24.956660 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:24.959511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:24.959511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:24.962209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:25.097884 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:25.109242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:25.110976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:25.112151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6eb9765f-bcde-4483-9e5b-4ae9dc78a460 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.168246 May 23 20:29:25.112727 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 473/921] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:24 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:26.134602 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:26.135288 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:26.141900 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:26.142405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:26.143395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:26.143826 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:26.295956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:26.307236 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:26.309608 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:26.310182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-aa9cbdd5-4a3b-458a-b928-f49b58e17122 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.179674 May 23 20:29:26.321483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 449/922] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:26 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:27.333151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:27.333151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:27.340429 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:27.340871 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:27.341812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:27.342593 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:27.519268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:27.530292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:27.532300 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:27.533772 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c4966cc3-2d89-4edd-b948-a831c213f9f5 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.209382 May 23 20:29:27.545481 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 474/923] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:27 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:28.552134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:28.552738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:28.555168 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:28.560200 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:28.560377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:28.561144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:28.561581 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:28.699674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:28.708531 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:28.710114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:28.711315 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2e93385b-26d9-4e4f-9413-a8ba2eb4b515 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.163091 May 23 20:29:28.711875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 450/924] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:28 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:29.129938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-e6fab4ba-3252-421a-8995-bf26b69c5302 req-51972d5f-c033-4a42-921d-2719dd147fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac", "name": "network-vif-plugged", "status": "completed", "tag": "d964f307-0816-459b-b91f-c56aa300d183"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:29.142709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-e6fab4ba-3252-421a-8995-bf26b69c5302 req-51972d5f-c033-4a42-921d-2719dd147fce service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:29.147971 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-e6fab4ba-3252-421a-8995-bf26b69c5302 req-51972d5f-c033-4a42-921d-2719dd147fce service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:29.154854 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-e6fab4ba-3252-421a-8995-bf26b69c5302 req-51972d5f-c033-4a42-921d-2719dd147fce service nova] Creating event network-vif-plugged:d964f307-0816-459b-b91f-c56aa300d183 for instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac on hv-cinder-84301 May 23 20:29:29.160408 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-e6fab4ba-3252-421a-8995-bf26b69c5302 req-51972d5f-c033-4a42-921d-2719dd147fce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037920 May 23 20:29:29.161080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 475/925] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:29:29.729734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:29.730417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:29.737557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:29.738138 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:29.739276 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:29.739665 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:29.902537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:29.914789 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:29.916340 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:29.917554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9827d68e-f359-4ac3-97b9-5f3cff091fad tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.192108 May 23 20:29:29.918145 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 451/926] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:29 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:30.936084 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:30.937320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:30.945107 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:30.948017 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:30.948891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:30.949863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:30.954241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:31.112473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:31.122595 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:31.124445 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:31.126485 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-83b01f00-e72b-489f-9b80-e4836c43abe3 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.194525 May 23 20:29:31.128103 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 476/927] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:30 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:32.145408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:32.146158 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:32.158631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:32.159160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:32.160404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:32.161020 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:32.449284 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:32.458081 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:32.459622 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:32.460787 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-63f48c46-9a35-482c-a56a-69e0da24d433 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.319708 May 23 20:29:32.474402 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 452/928] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:32 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:33.495268 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:33.496477 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:33.509320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:33.513973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:33.513973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:33.513973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:33.645509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:33.653577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:33.655142 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:33.656301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1c733124-80cb-4b7b-816f-38c4da6faec7 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.170394 May 23 20:29:33.657044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 477/929] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:33 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:34.674546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:34.675202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:34.685299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:34.685772 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:34.686950 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:34.687401 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:34.884878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:34.895740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:34.900630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:34.902652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9fbbcf83-bc1d-4247-9557-1c21740c60eb tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1730 microversion: 2.20 time: 0.232131 May 23 20:29:34.903827 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 453/930] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:34 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:29:35.921291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:35.921903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:35.929891 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:35.932100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:35.932100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:35.932100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:36.141239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:36.148723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:36.150430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:36.151685 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-43242fc8-28c0-4175-89e2-d05831b7f676 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1717 microversion: 2.20 time: 0.234853 May 23 20:29:36.152325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 478/931] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:29:35 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1717 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 23 20:29:54.107785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dbc060e9-6fbb-41df-898a-4d7875234f8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Action: 'create', calling method: .version_select at 0x7f996d52e160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-124171138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwLFAVOom5CznGt3syPgRamlr6MOirJBhwd33XBJtvBlPV34WWufhCNlMFjWYjhVNeqlo89cscqnhrBtTlkaBa5RUHj789gCEfzXo3wcosPjBMbssy4X0PioCEeobcMXA=="}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:54.111980 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=7 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:54.112634 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=63 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:54.123035 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-dbc060e9-6fbb-41df-898a-4d7875234f8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Getting quotas for project add3d6328c754244a17f23d21ff30fac. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:29:54.126814 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-dbc060e9-6fbb-41df-898a-4d7875234f8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Getting quotas for user e6dc0d72c1fb4c2fb4f0b704ffafadb1 and project add3d6328c754244a17f23d21ff30fac. Resources: {'key_pairs'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:29:54.231626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dbc060e9-6fbb-41df-898a-4d7875234f8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.127644 May 23 20:29:54.232229 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 454/932] 10.222.0.16 () {60 vars in 1158 bytes} [Mon May 23 20:29:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:29:54.327114 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1354995848", "imageRef": "90bd6003-3d3d-47ed-8c6e-5057dd420865", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-124171138", "networks": [{"uuid": "7e5fded9-e8cc-49d8-986b-8a61204706ef"}]}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:29:54.334472 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=5 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:54.335127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=31 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:29:54.376735 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] validate_networks() for [('7e5fded9-e8cc-49d8-986b-8a61204706ef', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:29:54.823476 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:29:54.823892 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:29:54.824357 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:29:54.824765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:29:54.825197 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:29:54.834146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:54.834587 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:54.835372 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:54.835803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:54.853301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Getting quotas for project add3d6328c754244a17f23d21ff30fac. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:29:54.857176 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Getting quotas for user e6dc0d72c1fb4c2fb4f0b704ffafadb1 and project add3d6328c754244a17f23d21ff30fac. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:29:54.868650 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:29:54.870840 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='90bd6003-3d3d-47ed-8c6e-5057dd420865',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:29:54.969390 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5577e27d-a3f2-48eb-b1cc-a66e372bd8a9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646469 May 23 20:29:54.970056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 479/933] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:29:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:29:54.980491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-146291ec-1cc2-4444-a157-39c13df261d7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:54.981392 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-146291ec-1cc2-4444-a157-39c13df261d7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:55.039366 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-146291ec-1cc2-4444-a157-39c13df261d7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:55.047597 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-146291ec-1cc2-4444-a157-39c13df261d7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1258 microversion: 2.1 time: 0.071109 May 23 20:29:55.048152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 455/934] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:54 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:56.064939 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d6c4c174-d63e-4e3e-a5d6-485a204c251f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:56.066189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d6c4c174-d63e-4e3e-a5d6-485a204c251f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:56.124107 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d6c4c174-d63e-4e3e-a5d6-485a204c251f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:56.132816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d6c4c174-d63e-4e3e-a5d6-485a204c251f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1258 microversion: 2.1 time: 0.071896 May 23 20:29:56.133369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 480/935] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:56 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:57.150449 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:57.151059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:57.158377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:57.158884 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:57.159642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:57.160078 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:57.221969 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:57.231492 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e9ae65c7-a112-4cc8-9db6-4aeadd0eef28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1262 microversion: 2.1 time: 0.085007 May 23 20:29:57.232065 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 456/936] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:57 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:58.248286 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:58.248930 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:58.255505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:58.255956 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:58.256715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:58.257151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:58.315633 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:58.323174 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9fb13b65-7c6b-427e-a0fc-8e7a5dfc2fb6 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1254 microversion: 2.1 time: 0.078507 May 23 20:29:58.323730 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 481/937] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:58 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1254 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:29:59.341005 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:29:59.341611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:29:59.349161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:59.352904 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:59.352904 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:29:59.352904 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:29:59.426510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:29:59.434198 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-eac54e71-8572-4583-8f56-9b53fcb4ac95 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1318 microversion: 2.1 time: 0.097371 May 23 20:29:59.438285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 457/938] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:29:59 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:00.452673 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:00.453296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:00.465085 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:00.468810 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:00.469829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:00.473330 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:00.729905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:00.746490 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-56659a47-ad7a-4395-8396-912e3fd5af3f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.297657 May 23 20:30:00.747378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 482/939] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:00 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:01.718914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-6aa87318-c2a1-49b5-9a00-cbd3dc4131fb req-0d31f788-4781-4e33-b8bb-edd9a7f142c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:01.735652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-6aa87318-c2a1-49b5-9a00-cbd3dc4131fb req-0d31f788-4781-4e33-b8bb-edd9a7f142c3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:01.736090 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-6aa87318-c2a1-49b5-9a00-cbd3dc4131fb req-0d31f788-4781-4e33-b8bb-edd9a7f142c3 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:01.757162 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-6aa87318-c2a1-49b5-9a00-cbd3dc4131fb req-0d31f788-4781-4e33-b8bb-edd9a7f142c3 service nova] Creating event network-changed:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:30:01.763780 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-6aa87318-c2a1-49b5-9a00-cbd3dc4131fb req-0d31f788-4781-4e33-b8bb-edd9a7f142c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048782 May 23 20:30:01.765119 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:01.766322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:01.775986 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 458/940] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:01.776610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:01.776610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:01.776610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:01.776610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:01.969565 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:01.980892 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b739e4fc-c8c9-4f15-bb6d-0e669700ecca tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.219171 May 23 20:30:01.982192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 483/941] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:01 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:02.999776 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:03.000522 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:03.014376 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:03.017931 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:03.023485 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:03.024221 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:03.229539 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:03.237728 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-65c4dd55-0378-4068-bb26-b87f347e92e4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.242786 May 23 20:30:03.238875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 459/942] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:02 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:04.257326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:04.258104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:04.269261 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:04.270038 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:04.274542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:04.275549 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:04.443440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:04.444311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:04.458623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:04.460006 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:04.466671 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:04.467199 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:04.535076 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:30:04.554497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:04.572020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f15fad1b-c577-4f7a-8e03-932941cf2a82 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.319774 May 23 20:30:04.577323 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 484/943] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:04 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:04.587973 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-ec8cecb8-4f16-473a-9c45-468a8db36ec2 req-4807ec2b-5628-4ca2-8b42-02e6d9f0b907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18", "tag": "e3fbb816-fd5a-4989-8f75-4be912227768"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:04.597904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ec8cecb8-4f16-473a-9c45-468a8db36ec2 req-4807ec2b-5628-4ca2-8b42-02e6d9f0b907 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:04.598662 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ec8cecb8-4f16-473a-9c45-468a8db36ec2 req-4807ec2b-5628-4ca2-8b42-02e6d9f0b907 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:04.625317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-ec8cecb8-4f16-473a-9c45-468a8db36ec2 req-4807ec2b-5628-4ca2-8b42-02e6d9f0b907 service nova] Creating event network-changed:e3fbb816-fd5a-4989-8f75-4be912227768 for instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 on hv-cinder-84301 May 23 20:30:04.647351 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-ec8cecb8-4f16-473a-9c45-468a8db36ec2 req-4807ec2b-5628-4ca2-8b42-02e6d9f0b907 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067832 May 23 20:30:04.648116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 485/944] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:04.864768 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fdf02c57-d42b-4170-85b7-d3918ae1270f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 204 len: 0 microversion: 2.1 time: 0.427023 May 23 20:30:04.866399 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 460/945] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:30:04 2022] DELETE /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 23 20:30:04.872089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:04.876317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:04.877031 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:04.888664 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:04.889398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:04.891006 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:04.892437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:05.115966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:05.124104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-61c34e21-d762-4ab8-b11f-efdab8db6f32 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.252868 May 23 20:30:05.124686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 486/946] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:04 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:05.600698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:05.600698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:05.600698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:05.608878 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:05.610480 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:05.613092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:05.614659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:05.825034 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:05.843630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e3d40990-73dc-49b7-ba84-5d25d55fd933 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.252681 May 23 20:30:05.849277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 461/947] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:05 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:06.143355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:06.144669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:06.148726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=8 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:06.152545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:06.153190 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:06.154216 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:06.154644 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:06.297595 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:06.306449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c8393ae7-8188-44eb-aa14-9d39802bc7f1 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.167305 May 23 20:30:06.308669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 487/948] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:06 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:06.860858 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:06.862377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:06.869364 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:06.870182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:06.871233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:06.871875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:07.055982 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:07.070682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-11452af7-b6ce-4ffc-922c-7111156456be tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.207538 May 23 20:30:07.070682 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 462/949] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:06 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:07.324265 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:07.325193 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:07.332524 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:07.334450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:07.334450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:07.334450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:07.498314 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:07.507569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1cc8ad1d-8cb7-44f4-aeae-2b801f98e7ce tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.187757 May 23 20:30:07.508413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 488/950] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:07 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:08.084024 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:08.085298 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:08.093119 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:08.093573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:08.094397 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:08.094838 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:08.266617 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:08.274779 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-214ad41d-6252-4329-9228-1c54d01bfe25 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.196335 May 23 20:30:08.275342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 463/951] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:08 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:08.524778 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:08.525378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:08.532165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:08.532623 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:08.533395 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:08.534417 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:08.664520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:08.673228 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-03b2af76-68f3-4e21-90e7-8ace5497bea9 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.152405 May 23 20:30:08.673793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 489/952] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:08 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:09.291421 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:09.292071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:09.298443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:09.298888 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:09.299854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:09.300286 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:09.432151 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:09.439580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-001a5aa2-dba0-4339-9391-bf98075a72cc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.151902 May 23 20:30:09.440759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 464/953] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:09 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:09.691784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:09.692399 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:09.699114 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:09.699561 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:09.700320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:09.700751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:09.832876 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:09.840625 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b32b2e2b-4b14-47a4-9298-82e1dbd06a87 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.153252 May 23 20:30:09.841191 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 490/954] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:09 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:10.457720 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:10.460988 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:10.466919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:10.467374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:10.468144 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:10.468583 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:10.670056 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:10.677807 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9a3ba112-a4d4-4b09-91b7-5e30da0929a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.224886 May 23 20:30:10.678481 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 465/955] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:10 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:10.858212 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:10.858750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:10.865635 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:10.866091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:10.866851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:10.867284 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:10.999242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:11.007416 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-85c8b20f-182f-4086-a3a7-bda967503bd2 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.153255 May 23 20:30:11.007978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 491/956] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:10 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:11.694470 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:11.695153 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:11.701897 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:11.702381 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:11.703147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:11.703582 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:11.899016 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:11.907955 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-25164725-b2b7-412b-a30e-110f214a6b8a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.217429 May 23 20:30:11.908896 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 466/957] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:11 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:12.025766 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:12.026493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:12.036826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:12.036826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:12.036826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:12.036826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:12.226756 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:12.234501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-616cf945-3d04-463e-8ee4-b6873106056e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1568 microversion: 2.1 time: 0.213239 May 23 20:30:12.235068 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 492/958] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:12 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:12.925717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:12.926359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:12.934211 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:12.934656 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:12.938459 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:12.938459 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:13.165185 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-a088bfb6-7b3c-4b4e-9a1b-ee11358344bc req-12491a75-91df-4b4c-8561-1b79d127d82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18", "name": "network-vif-deleted", "tag": "e3fbb816-fd5a-4989-8f75-4be912227768"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:13.166200 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:13.166605 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-a088bfb6-7b3c-4b4e-9a1b-ee11358344bc req-12491a75-91df-4b4c-8561-1b79d127d82c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:13.166605 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-a088bfb6-7b3c-4b4e-9a1b-ee11358344bc req-12491a75-91df-4b4c-8561-1b79d127d82c service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:13.166995 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bf46d9b4-6600-4625-8e0c-2a41fff00774 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.232142 May 23 20:30:13.166995 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 467/959] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:12 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:13.167155 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-a088bfb6-7b3c-4b4e-9a1b-ee11358344bc req-12491a75-91df-4b4c-8561-1b79d127d82c service nova] Creating event network-vif-deleted:e3fbb816-fd5a-4989-8f75-4be912227768 for instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 on hv-cinder-84301 May 23 20:30:13.175106 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-a088bfb6-7b3c-4b4e-9a1b-ee11358344bc req-12491a75-91df-4b4c-8561-1b79d127d82c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038926 May 23 20:30:13.175677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 493/960] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:13.250838 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:13.251500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:13.257644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:13.258122 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:13.258874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:13.259302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:13.336208 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:13.345370 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8f902fc0-fcb1-4502-b6ed-8f313017b05e tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1381 microversion: 2.1 time: 0.098279 May 23 20:30:13.345981 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 468/961] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:13 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1381 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:14.181580 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:14.182348 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:14.189855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:14.190504 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:14.191287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:14.193786 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:14.325758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:14.333564 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-804076ff-70ce-4d4a-814e-58b5e9dfdb6a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.157226 May 23 20:30:14.334160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 494/962] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:14 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:14.364907 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:14.365596 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:14.372414 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:14.372866 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:14.373635 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:14.374389 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:14.442824 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:14.450604 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-98c03062-0a24-485d-9deb-e0ffb0c04d1f tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1218 microversion: 2.1 time: 0.090116 May 23 20:30:14.451160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 469/963] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:14 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:15.350808 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:15.351420 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:15.357961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:15.358451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:15.359223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:15.359648 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:15.468179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:15.468795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:15.476185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:15.476763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:15.477537 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:15.477976 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:15.490207 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:15.497531 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-70d96801-a041-497f-a306-14e131aaa3a1 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.151355 May 23 20:30:15.498106 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 495/964] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:15 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:15.538278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:15.545650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-78f1d8ae-06ed-4c64-8c0f-775c58662470 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1218 microversion: 2.1 time: 0.082204 May 23 20:30:15.546233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 470/965] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:15 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:16.514501 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:16.515120 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:16.521537 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:16.521985 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:16.522787 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:16.523253 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:16.561328 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:16.561915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:16.568648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:16.569096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:16.569867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:16.570329 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:16.588310 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:16.640638 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:16.648770 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d621cfc8-ca6e-4f54-85c1-5a01c7654660 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1218 microversion: 2.1 time: 0.091192 May 23 20:30:16.649345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 471/966] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:16 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:16.674974 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:16.683567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-37f69304-2c36-44c7-808e-a6c413b8e5f8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.173186 May 23 20:30:16.684141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 496/967] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:16 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:17.668700 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:17.669437 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:17.677232 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:17.677683 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:17.678478 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:17.678914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:17.703089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:17.703725 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:17.710492 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:17.710938 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:17.711705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:17.712133 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:17.749019 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:17.757207 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-74904ad7-c4ec-41b1-8da9-8a079ce0f1cb tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1218 microversion: 2.1 time: 0.092477 May 23 20:30:17.757782 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 472/968] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:17 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:17.849439 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:17.857107 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-38d63075-8845-4c3d-a2bf-1eb0074fc8c5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.160294 May 23 20:30:17.857657 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 497/969] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:17 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:18.774714 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:18.775321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:18.781852 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:18.782326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:18.783160 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:18.783596 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:18.848255 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:18.855804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-312a14c2-fd34-417f-8433-db2f2bf0e644 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1218 microversion: 2.1 time: 0.085704 May 23 20:30:18.856367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 473/970] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:18 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:18.876056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:18.876804 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:18.884666 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:18.885121 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:18.885894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:18.886372 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:18.906318 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:19.014849 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:19.022999 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d0db8e9f-df08-45bd-92c5-48db10733aae tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.150747 May 23 20:30:19.023566 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 498/971] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:18 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:19.871408 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:19.872014 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:19.878595 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:19.879066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:19.879867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:19.880333 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:19.951612 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:19.960251 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4b045709-8144-4cf0-b786-f1a1d2fb5d40 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1218 microversion: 2.1 time: 0.092686 May 23 20:30:19.961084 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 474/972] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:19 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:20.039750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:20.040619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:20.047783 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:20.048470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:20.049459 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:20.050046 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:20.197935 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:20.205997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e8df2e3c-5d13-486a-8f9f-1e8959438f91 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.170906 May 23 20:30:20.207281 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 499/973] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:20 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:20.978940 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:20.979558 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:20.989630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:20.989630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:20.989630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:20.989630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.023360 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:21.023822 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.024272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lazy-loading 'fault' on Instance uuid 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:30:21.066975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be98a16abca4b5ea9e54a29f9b4ea62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8f120eaf89b4ef29fc92cf544ff1000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:21.075630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2c5c6eea-79f1-4037-bc37-5741f0830645 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 200 len: 1223 microversion: 2.1 time: 0.102086 May 23 20:30:21.076306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 475/974] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:20 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:21.223185 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:21.223796 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:21.230412 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:21.230854 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.231611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:21.232044 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.369564 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:21.377134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-612b66e8-813b-4bff-aff7-fba212ae33ab tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.157853 May 23 20:30:21.377819 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 500/975] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:21 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:21.765644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-63a23ef1-e84d-4710-b8fe-fcfb859933e2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:21.766801 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-63a23ef1-e84d-4710-b8fe-fcfb859933e2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:21.774937 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63a23ef1-e84d-4710-b8fe-fcfb859933e2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:21.775849 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63a23ef1-e84d-4710-b8fe-fcfb859933e2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.776628 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63a23ef1-e84d-4710-b8fe-fcfb859933e2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:21.777061 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-63a23ef1-e84d-4710-b8fe-fcfb859933e2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.812938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-63a23ef1-e84d-4710-b8fe-fcfb859933e2 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052806 May 23 20:30:21.813695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 476/976] 10.222.0.16 () {60 vars in 1342 bytes} [Mon May 23 20:30:21 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:21.879508 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:21.880005 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:21.886424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:21.887870 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.888648 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:21.889083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:21.915829 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:30:22.093319 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:22.093844 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] [instance: 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:22.100474 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:22.101333 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:22.102138 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:22.102579 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:22.117045 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] HTTP exception thrown: Instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 could not be found. May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Request method failure captured: May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 HTTP/1.1 May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-13ZUCSjgEt_JKRp3KSpTNp2tp52js3evmS_SMOjj9H_i8QfNqaQBqSLRSRrN5dWxeOvD7F40yo5kwLGA8bgFbk4oT9Qj0UKaasRSeGE9hoQi_sihDXqCR6uroWKwBpYg3ghgFjSUP3KEmAR9yFXs7EE9UayERUjyaMp_vPUAbYqAA May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: d8f120eaf89b4ef29fc92cf544ff1000 May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-TestShelveInstance-58245612 May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:30:22.118958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d8f120eaf89b4ef29fc92cf544ff1000", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8f120eaf89b4ef29fc92cf544ff1000"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d8f120eaf89b4ef29fc92cf544ff1000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d8f120eaf89b4ef29fc92cf544ff1000"}]}] May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-TestShelveInstance-58245612 May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: d8f120eaf89b4ef29fc92cf544ff1000 May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-TestShelveInstance-58245612 May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-TestShelveInstance-58245612-project May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 3be98a16abca4b5ea9e54a29f9b4ea62 May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-TestShelveInstance-58245612-project May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 could not be found. May 23 20:30:22.120642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18'} May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 could not be found. May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:30:22.121743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 could not be found. May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 could not be found. May 23 20:30:22.123301 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:22.124689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Returning 404 to user: Instance 4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:30:22.124689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5264fcfa-9c83-43d1-883b-0a533a9f7847 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18" status: 404 len: 111 microversion: 2.1 time: 0.031017 May 23 20:30:22.124689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 477/977] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:22 2022] GET /compute/v2.1/servers/4bdd32f9-4ccc-483b-bf04-7f0f4d97fb18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 23 20:30:22.169955 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-4c4f98a4-1781-4468-a088-fa19e4d545a6 req-5c854929-685d-4bc7-ade0-7688b5cef559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "name": "network-vif-plugged", "status": "completed", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:22.180467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-4c4f98a4-1781-4468-a088-fa19e4d545a6 req-5c854929-685d-4bc7-ade0-7688b5cef559 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:22.180942 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-4c4f98a4-1781-4468-a088-fa19e4d545a6 req-5c854929-685d-4bc7-ade0-7688b5cef559 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:22.195772 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-4c4f98a4-1781-4468-a088-fa19e4d545a6 req-5c854929-685d-4bc7-ade0-7688b5cef559 service nova] Creating event network-vif-plugged:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:30:22.201316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-4c4f98a4-1781-4468-a088-fa19e4d545a6 req-5c854929-685d-4bc7-ade0-7688b5cef559 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035417 May 23 20:30:22.202086 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 478/978] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:22.299248 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ffbb3b9d-7ef4-49d8-a009-56b26484a5a6 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 204 len: 0 microversion: 2.20 time: 0.423708 May 23 20:30:22.300617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 501/979] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 20:30:21 2022] DELETE /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 20:30:22.310179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:22.311025 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:22.318039 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:22.318494 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:22.319421 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:22.319864 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:22.395498 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:22.397493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:22.404510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:22.405193 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:22.406186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:22.406688 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:22.468223 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:22.477812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:22.479433 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:22.480622 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-738c62ee-da5b-49b0-833d-6e3cd3f3211c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.175098 May 23 20:30:22.481344 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 479/980] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:30:22 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:30:22.486328 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5a395b94-3623-47f0-b11c-4bd29226a912 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] Calling method '.version_select at 0x7f996d5823a0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:22.561356 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:22.569493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-83a19cc3-f355-4f51-9832-9ebcad2204e8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.178225 May 23 20:30:22.570134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 502/981] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:22 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:22.587916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5a395b94-3623-47f0-b11c-4bd29226a912 tempest-TestShelveInstance-58245612 tempest-TestShelveInstance-58245612-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-990032347" status: 202 len: 0 microversion: 2.1 time: 0.105264 May 23 20:30:22.588561 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 480/982] 10.222.0.16 () {58 vars in 1250 bytes} [Mon May 23 20:30:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-990032347 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:30:23.500518 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:23.501132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:23.508978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:23.509543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:23.510378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:23.510839 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:23.592326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:23.592941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:23.600314 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:23.600966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:23.601916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:23.602436 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:23.684890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:23.697319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:23.698983 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:23.700173 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-deefff1c-964d-43b9-a7b6-15f5fbb54383 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.203647 May 23 20:30:23.700731 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 503/983] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:30:23 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:30:23.863768 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:23.871071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e4289817-1d3d-46cc-a776-a3f399613226 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.283395 May 23 20:30:23.871630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 481/984] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:23 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:24.717976 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:24.718648 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:24.721053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:24.726379 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:24.726862 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:24.727628 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:24.728057 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:24.866010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:24.874581 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:24.876118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:24.877315 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f5a7433d-b9f6-4989-b106-391acfe1e61c tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1723 microversion: 2.20 time: 0.163187 May 23 20:30:24.878002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 504/985] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:30:24 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:30:24.891744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:24.892588 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:24.895174 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:24.900111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:24.900717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:24.906841 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:24.906841 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:25.169399 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:25.177147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-759cc349-346c-4d5c-a931-a91d5924a2b7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1358 microversion: 2.1 time: 0.289731 May 23 20:30:25.179542 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 482/986] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:24 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1358 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:25.712094 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-be334192-633b-4740-a8f1-9a31d59fc48e req-3c16798b-0635-4edd-80eb-267641d35b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac", "name": "network-vif-deleted", "tag": "d964f307-0816-459b-b91f-c56aa300d183"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:25.744567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-be334192-633b-4740-a8f1-9a31d59fc48e req-3c16798b-0635-4edd-80eb-267641d35b6b service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:25.748047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-be334192-633b-4740-a8f1-9a31d59fc48e req-3c16798b-0635-4edd-80eb-267641d35b6b service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:25.789141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-be334192-633b-4740-a8f1-9a31d59fc48e req-3c16798b-0635-4edd-80eb-267641d35b6b service nova] Creating event network-vif-deleted:d964f307-0816-459b-b91f-c56aa300d183 for instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac on hv-cinder-84301 May 23 20:30:25.795302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-be334192-633b-4740-a8f1-9a31d59fc48e req-3c16798b-0635-4edd-80eb-267641d35b6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092978 May 23 20:30:25.796250 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 505/987] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:25.900958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:25.902704 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:25.928032 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:25.929161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:25.933125 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:25.934538 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:26.062804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:26.071670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:26.074174 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c4586fdc3e8b4ee0ab58d8c236637a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a05af8ceb6d041a6a894d5ca3ff820cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:26.075533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e29da5d2-b6f8-4002-925c-5d70f6016b30 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 200 len: 1366 microversion: 2.20 time: 0.182974 May 23 20:30:26.076243 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 483/988] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:30:25 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 23 20:30:26.202001 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-286497108", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2119033645", "security_groups": [{"name": "tempest-secgroup-smoke-560179066"}], "block_device_mapping_v2": [{"uuid": "9f9e47f1-7d3c-4463-bb20-be6636088742", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d1b674a5-f902-453a-bbbe-6a61eb453929"}]}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:26.203905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:26.207599 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:26.223472 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:26.224356 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:26.225317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:26.226223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:26.440111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] validate_networks() for [('d1b674a5-f902-453a-bbbe-6a61eb453929', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:30:26.547086 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:26.571336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-777a649c-f0d2-4645-9f3e-79b8a94e52f3 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1548 microversion: 2.1 time: 0.365188 May 23 20:30:26.571336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 506/989] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:26 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1548 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:26.580526 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:26.581189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:26.593156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:26.593156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:26.593156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:26.593156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:26.834545 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:26.848164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-73be39dc-26a1-497c-a473-a05e2a2e7c2b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1548 microversion: 2.1 time: 0.271790 May 23 20:30:26.849344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 507/990] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:26 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1548 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:26.867098 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:26.872611 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:26.876214 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Searching by: {'deleted': False, 'project_id': 'add3d6328c754244a17f23d21ff30fac'} {{(pid=118170) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 23 20:30:26.897493 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:26.901251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:26.903607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:26.904127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:27.066813 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.multi_cell_list [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118170) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 23 20:30:27.194675 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4972dadb-015e-4f5d-a82b-f1dc3e237c28 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.332265 May 23 20:30:27.196380 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 508/991] 10.222.0.16 () {58 vars in 1124 bytes} [Mon May 23 20:30:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:30:27.208355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:27.208355 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:27.217204 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:30:27.218804 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:30:27.219493 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:30:27.220163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:30:27.221349 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:30:27.244853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:27.244967 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:27.245254 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:27.245841 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:27.246816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:27.248456 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:27.249062 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:27.249648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:27.292234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for project 26567fb564314003bf5ae836737b990e. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:30:27.292668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] HTTP exception thrown: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Request method failure captured: May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac HTTP/1.1 May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-06NRYKCrvAuSC5fecg2m10JBTSIJG0bBXCNEja1bIajuEq0Eol0UMScEUTATzeEinhib3ZY_BwjCrmAsbwlwN1ANVmRWW5se8PeY0h13-Kb_WRMJK0SOd6OtAi0nSWzia05_-yIyYSfgIhXluqEU1cnfprK3e3KgPqae4JorXbgVk May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Openstack-Nova-Api-Version: 2.20 May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:30:27.296511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a05af8ceb6d041a6a894d5ca3ff820cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}] May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: c4586fdc3e8b4ee0ab58d8c236637a4f May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:27.298002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': 'cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac'} May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:30:27.298942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:27.300211 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:27.301339 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Returning 404 to user: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:30:27.301339 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e97a57c0-81a0-4285-8396-bcfe662654ff tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 404 len: 111 microversion: 2.20 time: 0.098754 May 23 20:30:27.302054 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 509/992] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:30:27 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 20:30:27.320787 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:27.320787 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:27.321531 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Getting quotas for user 7231b60e5f9541629fec2291c547f0f4 and project 26567fb564314003bf5ae836737b990e. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:30:27.334625 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:27.335231 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:27.336998 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:27.337568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:27.428882 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:30:27.431007 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f9e47f1-7d3c-4463-bb20-be6636088742',volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:30:27.981155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-43dcb59f-f9e2-412f-8523-6fd945bbc751 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.785167 May 23 20:30:28.001345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 484/993] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:30:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:30:28.001457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:28.009062 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bb952c73-d62d-4a20-be4f-91ac9f54ad3b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1548 microversion: 2.1 time: 0.703968 May 23 20:30:28.012164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 510/994] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:27 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1548 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:28.014874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5e11a56c-99da-4e7f-b8f4-c5d13e32bbcf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '.version_select at 0x7f996d4874c0>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:28.048357 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f827d6f2-4259-4f7a-bb91-b5910becd8cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:28.049751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f827d6f2-4259-4f7a-bb91-b5910becd8cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:28.162382 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5e11a56c-99da-4e7f-b8f4-c5d13e32bbcf tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382161781" status: 204 len: 0 microversion: 2.20 time: 0.167118 May 23 20:30:28.163479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 485/995] 10.222.0.16 () {60 vars in 1261 bytes} [Mon May 23 20:30:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1382161781 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 23 20:30:28.247200 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f827d6f2-4259-4f7a-bb91-b5910becd8cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:28.257440 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f827d6f2-4259-4f7a-bb91-b5910becd8cd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1094 microversion: 2.1 time: 0.244070 May 23 20:30:28.268845 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 511/996] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:28 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1094 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:29.279130 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:29.279572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:29.288705 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:29.289110 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:29.290312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:29.290983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:29.439733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:29.448896 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a80fdaad-cda0-48f2-850c-fef9b686c359 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1144 microversion: 2.1 time: 0.175000 May 23 20:30:29.449977 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 486/997] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:29 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1144 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:30.228336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-af780c21-8b81-4ffb-b5e0-e3a9b92640f5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "813a19a1-edbc-4594-b7b0-51d41202057a"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:30.229458 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-af780c21-8b81-4ffb-b5e0-e3a9b92640f5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:30.237222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-af780c21-8b81-4ffb-b5e0-e3a9b92640f5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.240475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-af780c21-8b81-4ffb-b5e0-e3a9b92640f5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.240475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-af780c21-8b81-4ffb-b5e0-e3a9b92640f5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.240475 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-af780c21-8b81-4ffb-b5e0-e3a9b92640f5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.465703 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:30.466391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:30.480961 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.482800 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.484666 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.485117 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.591501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:30.600299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9fad5de5-fa15-4f0b-a5ac-fab49c4fe636 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1200 microversion: 2.1 time: 0.138639 May 23 20:30:30.600886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 487/998] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:30 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1200 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:30.610114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:30.610114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:30.618457 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.624084 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.624084 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.624084 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.642806 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] HTTP exception thrown: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Request method failure captured: May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: DELETE /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac HTTP/1.1 May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-06NRYKCrvAuSC5fecg2m10JBTSIJG0bBXCNEja1bIajuEq0Eol0UMScEUTATzeEinhib3ZY_BwjCrmAsbwlwN1ANVmRWW5se8PeY0h13-Kb_WRMJK0SOd6OtAi0nSWzia05_-yIyYSfgIhXluqEU1cnfprK3e3KgPqae4JorXbgVk May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Openstack-Nova-Api-Version: 2.20 May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:30:30.644641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a05af8ceb6d041a6a894d5ca3ff820cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}] May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: c4586fdc3e8b4ee0ab58d8c236637a4f May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.646557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': 'cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac'} May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:30:30.647812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.649351 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.651651 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Returning 404 to user: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:30:30.651651 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-dd422ebf-3f58-404a-b308-1c4ed77ed802 tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 404 len: 111 microversion: 2.20 time: 0.042830 May 23 20:30:30.651651 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 488/999] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 20:30:30 2022] DELETE /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 20:30:30.654979 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:30.655576 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:30.662753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.664501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.664501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:30.665017 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:30.682458 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] HTTP exception thrown: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Request method failure captured: May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac HTTP/1.1 May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-06NRYKCrvAuSC5fecg2m10JBTSIJG0bBXCNEja1bIajuEq0Eol0UMScEUTATzeEinhib3ZY_BwjCrmAsbwlwN1ANVmRWW5se8PeY0h13-Kb_WRMJK0SOd6OtAi0nSWzia05_-yIyYSfgIhXluqEU1cnfprK3e3KgPqae4JorXbgVk May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Openstack-Nova-Api-Version: 2.20 May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:30:30.684306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a05af8ceb6d041a6a894d5ca3ff820cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}] May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: c4586fdc3e8b4ee0ab58d8c236637a4f May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.685684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': 'cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac'} May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:30:30.686541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. May 23 20:30:30.687743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:30.689550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Returning 404 to user: Instance cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:30:30.690642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3f4e0d45-7782-4900-a349-5c0555de1d6d tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac" status: 404 len: 111 microversion: 2.20 time: 0.039748 May 23 20:30:30.691942 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 489/1000] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:30:30 2022] GET /compute/v2.1/servers/cfb7d8ff-9260-4fc2-b9ec-0850d0af9bac => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 23 20:30:31.248601 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-af780c21-8b81-4ffb-b5e0-e3a9b92640f5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.024030 May 23 20:30:31.255382 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 512/1001] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:30:30 2022] POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:30:31.616938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:31.617739 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:31.627600 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:31.628101 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:31.629690 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:31.630472 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:31.712678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1449011996", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "networks": [{"uuid": "919b7971-d637-4aef-92ae-1c5ac0e055d6"}]}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:31.783241 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] validate_networks() for [('919b7971-d637-4aef-92ae-1c5ac0e055d6', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:30:31.847923 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:31.857935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a0c06e9c-4cc3-4e10-b83c-1f72f92d7b57 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1277 microversion: 2.1 time: 0.242805 May 23 20:30:31.857935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 490/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:31 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:32.104820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:32.105479 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:32.115942 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.121429 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.122434 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.122975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.159830 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] HTTP exception thrown: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Request method failure captured: May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: DELETE /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 HTTP/1.1 May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-06NRYKCrvAuSC5fecg2m10JBTSIJG0bBXCNEja1bIajuEq0Eol0UMScEUTATzeEinhib3ZY_BwjCrmAsbwlwN1ANVmRWW5se8PeY0h13-Kb_WRMJK0SOd6OtAi0nSWzia05_-yIyYSfgIhXluqEU1cnfprK3e3KgPqae4JorXbgVk May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Openstack-Nova-Api-Version: 2.20 May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:30:32.162762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a05af8ceb6d041a6a894d5ca3ff820cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}] May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: c4586fdc3e8b4ee0ab58d8c236637a4f May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.164573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '27d11af6-2834-47d4-92cc-ee3135a9f976'} May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:30:32.166210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.167611 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.177499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Returning 404 to user: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:30:32.177499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b0a94e32-8762-47f3-b0f5-dd73ff7bf10a tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "DELETE /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 404 len: 111 microversion: 2.20 time: 0.068113 May 23 20:30:32.177499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 491/1003] 10.222.0.16 () {60 vars in 1279 bytes} [Mon May 23 20:30:32 2022] DELETE /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 23 20:30:32.187296 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:32.188842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] [instance: 27d11af6-2834-47d4-92cc-ee3135a9f976] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:32.208452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.210452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.214840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.217886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.242252 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] HTTP exception thrown: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Request method failure captured: May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 HTTP/1.1 May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-06NRYKCrvAuSC5fecg2m10JBTSIJG0bBXCNEja1bIajuEq0Eol0UMScEUTATzeEinhib3ZY_BwjCrmAsbwlwN1ANVmRWW5se8PeY0h13-Kb_WRMJK0SOd6OtAi0nSWzia05_-yIyYSfgIhXluqEU1cnfprK3e3KgPqae4JorXbgVk May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Openstack-Nova-Api-Version: 2.20 May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:30:32.245057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a05af8ceb6d041a6a894d5ca3ff820cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a05af8ceb6d041a6a894d5ca3ff820cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a05af8ceb6d041a6a894d5ca3ff820cc"}]}] May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: a05af8ceb6d041a6a894d5ca3ff820cc May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-974988491 May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: c4586fdc3e8b4ee0ab58d8c236637a4f May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-AttachVolumeShelveTestJSON-974988491-project May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.246744 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '27d11af6-2834-47d4-92cc-ee3135a9f976'} May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:30:32.247753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. May 23 20:30:32.249202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:30:32.252057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] Returning 404 to user: Instance 27d11af6-2834-47d4-92cc-ee3135a9f976 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:30:32.253130 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-93186e40-99c7-443a-939f-8b970b7b8fea tempest-AttachVolumeShelveTestJSON-974988491 tempest-AttachVolumeShelveTestJSON-974988491-project] 10.222.0.16 "GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976" status: 404 len: 111 microversion: 2.20 time: 0.078593 May 23 20:30:32.255055 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 492/1004] 10.222.0.16 () {60 vars in 1276 bytes} [Mon May 23 20:30:32 2022] GET /compute/v2.1/servers/27d11af6-2834-47d4-92cc-ee3135a9f976 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 23 20:30:32.807342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:30:32.807888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:30:32.808244 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:30:32.809533 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:30:32.809958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:30:32.826568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.826961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.828020 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.828205 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.875273 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:32.875892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:32.891888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Getting quotas for project a656c669853f430a9a23e5568d1adb7a. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:30:32.899222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Getting quotas for user ae021e81bd724b8085a2e384576946dc and project a656c669853f430a9a23e5568d1adb7a. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:30:32.899342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.899706 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.900820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:32.901923 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:32.913610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:30:32.918132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:30:33.071415 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-34a75ac5-7907-4fbf-8f31-1fe615003e7a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366644 May 23 20:30:33.073065 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 513/1005] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:30:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 23 20:30:33.084151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5b240f44-b5bc-46b0-89b0-819891c936b7 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:33.084813 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5b240f44-b5bc-46b0-89b0-819891c936b7 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:33.139891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:33.147634 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d86f2ac1-ce35-462a-87f1-33087a1b41f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.277292 May 23 20:30:33.148196 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 493/1006] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:32 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:33.158954 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-f3f753ae-df6d-4593-ae81-9d644ba452cb req-227288c6-a277-4488-93eb-92515ac2a1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd", "tag": "3da1951e-32c2-4a10-87c3-ed8bd6400eff"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:33.171018 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-f3f753ae-df6d-4593-ae81-9d644ba452cb req-227288c6-a277-4488-93eb-92515ac2a1ba service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:33.171699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-f3f753ae-df6d-4593-ae81-9d644ba452cb req-227288c6-a277-4488-93eb-92515ac2a1ba service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:33.184484 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-f3f753ae-df6d-4593-ae81-9d644ba452cb req-227288c6-a277-4488-93eb-92515ac2a1ba service nova] Creating event network-changed:3da1951e-32c2-4a10-87c3-ed8bd6400eff for instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd on hv-cinder-84301 May 23 20:30:33.192218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-f3f753ae-df6d-4593-ae81-9d644ba452cb req-227288c6-a277-4488-93eb-92515ac2a1ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038126 May 23 20:30:33.192218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 494/1007] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:33.251966 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5b240f44-b5bc-46b0-89b0-819891c936b7 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:33.285196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5b240f44-b5bc-46b0-89b0-819891c936b7 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1214 microversion: 2.1 time: 0.203933 May 23 20:30:33.294192 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 514/1008] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:33 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:34.168097 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:34.168942 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:34.176355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:34.176807 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:34.177616 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:34.178080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:34.197314 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:34.306370 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-443b302f-4ba6-47be-bd41-03845e5cbbde tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:34.307164 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-443b302f-4ba6-47be-bd41-03845e5cbbde tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:34.327643 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:34.336590 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-456e3b15-dd21-4f24-aaac-11127d5ea9e1 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.174720 May 23 20:30:34.337187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 495/1009] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:34 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:34.489092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-443b302f-4ba6-47be-bd41-03845e5cbbde tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:34.498369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-443b302f-4ba6-47be-bd41-03845e5cbbde tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1214 microversion: 2.1 time: 0.202179 May 23 20:30:34.504232 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 515/1010] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:34 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:35.355220 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:35.356451 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:35.367342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:35.367786 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:35.368728 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:35.369428 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:35.515397 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:35.515918 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:35.529048 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:35.529500 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:35.531765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:35.532402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:35.684077 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:35.688233 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:35.695594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d75c2182-d86c-43e9-b6c5-69c5bcef8648 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1266 microversion: 2.1 time: 0.184018 May 23 20:30:35.698181 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 516/1011] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:35 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:35.868891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:35.888395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cf4ce4cf-86ad-41ce-9b71-415bcc8b9862 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.538721 May 23 20:30:35.889738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 496/1012] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:35 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:36.714430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:36.715131 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:36.723835 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:36.724309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:36.725706 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:36.726250 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:36.838731 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:36.863717 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cf9d1dea-4be0-4a08-bf30-2b076bc6f8c5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1272 microversion: 2.1 time: 0.152562 May 23 20:30:36.865751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 517/1013] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:36 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:36.906660 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:36.907647 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:36.919401 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:36.924882 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:36.929345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:36.929985 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:37.281490 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:37.335444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:37.593778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:37.609933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6773121d-847c-4909-a8c3-ea0a32ede3b8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.707415 May 23 20:30:37.621842 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 497/1014] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:36 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:37.887802 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:37.889224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:37.938247 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:37.942647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:37.945991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:37.947539 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:38.344049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:38.367034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7d094cc2-ac27-4f62-8a4f-73caffaab22f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.482627 May 23 20:30:38.376745 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 518/1015] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:37 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:38.627317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:38.627916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:38.635521 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:38.635952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:38.636775 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:38.637208 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:38.821627 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-344cead7-6a4f-4345-8bfa-b7e79f29afa3 req-5ad1acb3-f385-4e16-9de3-d48910a0bd7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f09c58d-1cbe-468e-bf90-5b36935b7bc4", "tag": "ab752c9a-d2ca-4213-bb55-f456a1cb67d5"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:38.836093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-344cead7-6a4f-4345-8bfa-b7e79f29afa3 req-5ad1acb3-f385-4e16-9de3-d48910a0bd7b service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:38.836726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-344cead7-6a4f-4345-8bfa-b7e79f29afa3 req-5ad1acb3-f385-4e16-9de3-d48910a0bd7b service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:38.866426 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-344cead7-6a4f-4345-8bfa-b7e79f29afa3 req-5ad1acb3-f385-4e16-9de3-d48910a0bd7b service nova] Creating event network-changed:ab752c9a-d2ca-4213-bb55-f456a1cb67d5 for instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 on hv-cinder-84301 May 23 20:30:38.880474 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-344cead7-6a4f-4345-8bfa-b7e79f29afa3 req-5ad1acb3-f385-4e16-9de3-d48910a0bd7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064581 May 23 20:30:38.882803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 519/1016] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:30:38.934966 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:38.944980 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1e8c78a1-9e59-4376-8e2b-24c15d4b164b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.321453 May 23 20:30:38.945730 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 498/1017] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:38 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:39.385377 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:39.387061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:39.403024 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:39.403482 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:39.404369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:39.404809 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:39.559366 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:39.567548 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5724e46f-ddd7-46a9-8507-0bf4008611d5 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.187028 May 23 20:30:39.568797 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 520/1018] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:39 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:39.964924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:39.964924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:39.969998 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:39.974458 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:39.975306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:39.975750 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:40.164285 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:40.185518 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e09767a0-bd30-4611-8e3a-920894185542 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.226666 May 23 20:30:40.188824 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 499/1019] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:39 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:40.383920 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:40.384540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:40.392726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:40.393292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:40.394755 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:40.395202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:40.572411 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:40.586230 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:40.586841 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:40.590434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-36390b61-f935-4852-ab75-372ec474e932 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1594 microversion: 2.1 time: 0.210755 May 23 20:30:40.596088 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:40.596201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 521/1020] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:40 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1594 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:40.596337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:40.596337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:40.596337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:40.764464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:40.779023 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-49f42072-35e7-49c8-ab4f-386c576f22e9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.196705 May 23 20:30:40.779821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 500/1021] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:40 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:41.204541 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:41.207538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:41.225421 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:41.225684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:41.235152 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:41.236007 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:41.464067 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:41.478303 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-50c1289e-0e68-462e-8e7a-f8ad207f73e9 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.278171 May 23 20:30:41.488054 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 522/1022] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:41 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:41.796900 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:41.797509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:41.808340 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:41.809299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:41.810683 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:41.811427 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:42.017295 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:42.035491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0aa30a9c-ddcb-4907-9243-9f7c9d9dc7bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.236373 May 23 20:30:42.035491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 501/1023] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:41 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:42.500932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:42.500932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:42.513263 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:42.513709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:42.517845 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:42.523148 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:42.848432 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=4 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:42.893291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:42.914816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-07d0c0b1-4771-43a8-b1b2-ab5f05bf13df tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.419079 May 23 20:30:42.914816 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 523/1024] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:42 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:43.050156 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:43.055755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:43.072241 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:43.072963 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:43.073920 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:43.079781 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:43.255155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:43.263462 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bd8f8750-c3a4-4b8e-b6c6-7ec45bfe5b75 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.217083 May 23 20:30:43.264493 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 502/1025] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:43 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:43.733162 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-a9d7b270-a171-4938-b827-27e8f6ccf4c2 req-a8af525a-d344-417d-9fe2-7c35e3be6895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:43.742570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-a9d7b270-a171-4938-b827-27e8f6ccf4c2 req-a8af525a-d344-417d-9fe2-7c35e3be6895 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:43.743010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-a9d7b270-a171-4938-b827-27e8f6ccf4c2 req-a8af525a-d344-417d-9fe2-7c35e3be6895 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:43.760784 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-a9d7b270-a171-4938-b827-27e8f6ccf4c2 req-a8af525a-d344-417d-9fe2-7c35e3be6895 service nova] Creating event network-changed:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:30:43.766748 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-a9d7b270-a171-4938-b827-27e8f6ccf4c2 req-a8af525a-d344-417d-9fe2-7c35e3be6895 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038108 May 23 20:30:43.772406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 524/1026] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:43.935877 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:43.936827 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:43.944179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:43.944631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:43.950368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:43.950368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:44.282814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:44.283783 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:44.291538 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:44.292178 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:44.293244 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:44.293840 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:44.378946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:44.387506 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-223e6766-e371-4527-8ba3-a2e0007d21c7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.460987 May 23 20:30:44.388109 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 503/1027] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:43 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:44.493381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:44.497291 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=12 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:44.509815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-67f2a299-efab-4f28-9ae5-c7e19362f191 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.231220 May 23 20:30:44.510677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 525/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:44 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:44.804915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-04e10737-8fb4-4e7f-b2a8-9a50ddb1042f req-6d3e3499-d843-4021-a1c1-bc0442708d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f09c58d-1cbe-468e-bf90-5b36935b7bc4", "name": "network-vif-plugged", "status": "completed", "tag": "ab752c9a-d2ca-4213-bb55-f456a1cb67d5"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:44.814450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-04e10737-8fb4-4e7f-b2a8-9a50ddb1042f req-6d3e3499-d843-4021-a1c1-bc0442708d40 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:44.816456 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-04e10737-8fb4-4e7f-b2a8-9a50ddb1042f req-6d3e3499-d843-4021-a1c1-bc0442708d40 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:44.829742 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-04e10737-8fb4-4e7f-b2a8-9a50ddb1042f req-6d3e3499-d843-4021-a1c1-bc0442708d40 service nova] Creating event network-vif-plugged:ab752c9a-d2ca-4213-bb55-f456a1cb67d5 for instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 on hv-cinder-84301 May 23 20:30:44.836376 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-04e10737-8fb4-4e7f-b2a8-9a50ddb1042f req-6d3e3499-d843-4021-a1c1-bc0442708d40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036798 May 23 20:30:44.837544 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 504/1029] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:45.406320 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:45.407588 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:45.424771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:45.425811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:45.427338 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:45.427853 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:45.528111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:45.528697 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:45.541974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:45.542450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:45.543221 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:45.543659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:45.638675 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:45.652785 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-fed3eea2-89c2-4415-b10c-f8d1c2982608 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.249499 May 23 20:30:45.653361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 526/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:45 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:45.773750 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:45.782281 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-3c83e3c4-3d1d-4dbe-951b-e2fea82ecfad tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.259038 May 23 20:30:45.783433 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 505/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:45 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:46.670274 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:46.671420 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:46.678224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:46.678893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:46.679643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:46.680070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:46.800215 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:46.801104 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:46.807774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:46.809377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:46.809377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:46.809377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:46.842364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:46.851004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f05e2b7f-2568-4625-9af2-83cbb50cd72a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.184582 May 23 20:30:46.851658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 527/1032] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:46 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:46.857760 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-4ae2f8c1-26df-45fc-9559-53c72ce03166 req-1817bb40-41c6-4829-96de-508032fbb3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd", "name": "network-vif-plugged", "status": "completed", "tag": "3da1951e-32c2-4a10-87c3-ed8bd6400eff"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:46.867155 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-4ae2f8c1-26df-45fc-9559-53c72ce03166 req-1817bb40-41c6-4829-96de-508032fbb3b4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:46.872609 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-4ae2f8c1-26df-45fc-9559-53c72ce03166 req-1817bb40-41c6-4829-96de-508032fbb3b4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:46.881210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-4ae2f8c1-26df-45fc-9559-53c72ce03166 req-1817bb40-41c6-4829-96de-508032fbb3b4 service nova] Creating event network-vif-plugged:3da1951e-32c2-4a10-87c3-ed8bd6400eff for instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd on hv-cinder-84301 May 23 20:30:46.886463 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-4ae2f8c1-26df-45fc-9559-53c72ce03166 req-1817bb40-41c6-4829-96de-508032fbb3b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 May 23 20:30:46.887326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 528/1033] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:46.977824 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:46.985650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-aec4e4e2-c8cc-4114-bf82-7d986aa289e3 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1314 microversion: 2.1 time: 0.189331 May 23 20:30:46.986327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 506/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:46 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:47.125196 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1704280330"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:47.127566 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:47.136777 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:47.137282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:47.141494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:47.141494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:47.274578 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.network.security_group_api [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Adding security group b256790b-e2e2-4990-9bb8-c413ec567c72 to port 67a1ec00-9ca3-4f89-91f2-5e327a06d58b May 23 20:30:47.717344 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-58e707ec-abfd-4807-9540-920b8df68bf9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/action" status: 202 len: 0 microversion: 2.1 time: 0.599474 May 23 20:30:47.719467 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 529/1035] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:30:47 2022] POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:30:47.727745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-248b4cf3-4373-4b9e-8c47-9d0206cae70c req-e47399a1-d8df-4fba-864b-129114fe5021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:47.731651 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:47.731651 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:47.740413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:47.740647 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:47.742156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:47.742769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:47.751114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-248b4cf3-4373-4b9e-8c47-9d0206cae70c req-e47399a1-d8df-4fba-864b-129114fe5021 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:47.751573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-248b4cf3-4373-4b9e-8c47-9d0206cae70c req-e47399a1-d8df-4fba-864b-129114fe5021 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:47.789306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-248b4cf3-4373-4b9e-8c47-9d0206cae70c req-e47399a1-d8df-4fba-864b-129114fe5021 service nova] Creating event network-changed:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:30:47.798672 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-248b4cf3-4373-4b9e-8c47-9d0206cae70c req-e47399a1-d8df-4fba-864b-129114fe5021 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077269 May 23 20:30:47.799549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 507/1036] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:47.870087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:47.870806 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:47.881646 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:47.883096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:47.884114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:47.896429 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:47.952314 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:47.962543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-05e21d70-e4d6-4118-b48a-0f91892a5a94 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1760 microversion: 2.1 time: 0.237019 May 23 20:30:47.963139 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 530/1037] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:47 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1760 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:48.002744 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:48.004054 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:48.010322 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:48.010984 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:48.012039 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:48.012780 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:48.131748 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:48.142565 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7c969d43-d4cd-4b48-aafa-1713b31d50d8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1265 microversion: 2.1 time: 0.277627 May 23 20:30:48.155228 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 508/1038] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:47 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1265 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:48.200736 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:48.211050 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d6989c95-a535-4eda-ace6-c8a432a2866b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1498 microversion: 2.1 time: 0.212089 May 23 20:30:48.211734 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 531/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:47 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:49.174336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:49.175667 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:49.176555 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:49.178049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:49.185357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.190788 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.191115 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.191207 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.191301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.191391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.191479 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.191479 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.241955 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:30:49.377485 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:49.388607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-92d2e855-9e93-46bb-b4a3-ed70f84a1780 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1451 microversion: 2.1 time: 0.222288 May 23 20:30:49.389182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 509/1040] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:49 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1451 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:49.407572 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:49.408182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:49.414954 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.418890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.418890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.418890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.521464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-986bd7fc-d1f0-421e-a42c-17b27273e473 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 204 len: 0 microversion: 2.1 time: 0.350790 May 23 20:30:49.522070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 532/1041] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:30:49 2022] DELETE /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:30:49.531433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:49.532319 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:49.539243 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.540019 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.541080 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:49.541737 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:49.557937 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:49.567274 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ead45875-a5ab-4dca-831d-d55992ab0cf8 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1451 microversion: 2.1 time: 0.163518 May 23 20:30:49.568031 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 510/1042] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:49 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1451 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:49.718863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:49.726407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4aba9b8d-23b1-4e40-837e-5838e665a22a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1504 microversion: 2.1 time: 0.199260 May 23 20:30:49.726970 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 533/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:49 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:30:50.743294 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:50.743964 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:50.750928 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:50.751391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:50.752175 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:50.752610 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:50.996921 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:51.009091 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8137d87f-caa2-4a13-90cc-34c2f7fea656 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1504 microversion: 2.1 time: 0.268532 May 23 20:30:51.009843 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 511/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:50 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:52.025744 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:52.026515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:52.033237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:52.034710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:52.035756 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:52.036294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:52.040807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:52.208929 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:52.216365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-397a266b-d6dd-40ae-9b37-0938462c74aa tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 200 len: 1504 microversion: 2.1 time: 0.194952 May 23 20:30:52.217138 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 534/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:52 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:52.270056 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-0c1e29c2-d104-47a8-8013-9711b0f4edf5 req-b6ebcdaf-3cf7-40e5-9733-0c564a2f0fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f09c58d-1cbe-468e-bf90-5b36935b7bc4", "name": "network-vif-deleted", "tag": "ab752c9a-d2ca-4213-bb55-f456a1cb67d5"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:52.279246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-0c1e29c2-d104-47a8-8013-9711b0f4edf5 req-b6ebcdaf-3cf7-40e5-9733-0c564a2f0fa1 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:52.279688 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-0c1e29c2-d104-47a8-8013-9711b0f4edf5 req-b6ebcdaf-3cf7-40e5-9733-0c564a2f0fa1 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:52.291118 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-0c1e29c2-d104-47a8-8013-9711b0f4edf5 req-b6ebcdaf-3cf7-40e5-9733-0c564a2f0fa1 service nova] Creating event network-vif-deleted:ab752c9a-d2ca-4213-bb55-f456a1cb67d5 for instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 on hv-cinder-84301 May 23 20:30:52.296404 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-0c1e29c2-d104-47a8-8013-9711b0f4edf5 req-b6ebcdaf-3cf7-40e5-9733-0c564a2f0fa1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030466 May 23 20:30:52.299035 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 512/1046] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:53.233934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:53.234953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: 8f09c58d-1cbe-468e-bf90-5b36935b7bc4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:53.242372 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:53.243046 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:53.243811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:53.244325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:53.259512 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] HTTP exception thrown: Instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 could not be found. May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Request method failure captured: May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 HTTP/1.1 May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-7lsW2Vxjy5FLz4p8R3tYZcuaqylu-UcxrboeO424OCR3_fFydsVafAbxCsI9g7XD0LRVBeDPgAIEMQNqSICwRORdvTFda7yESKW454Atlf6QRHVrPZfYqSgD2Dy1dvSNHk6XBBKTImK9qxpKp4FzcuaKkxsXX9GnTy7vryr97jOJU May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: a656c669853f430a9a23e5568d1adb7a May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesActionsTest-1623377801 May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:30:53.261141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a656c669853f430a9a23e5568d1adb7a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a656c669853f430a9a23e5568d1adb7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a656c669853f430a9a23e5568d1adb7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a656c669853f430a9a23e5568d1adb7a"}]}] May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesActionsTest-1623377801 May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: a656c669853f430a9a23e5568d1adb7a May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesActionsTest-1623377801 May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesActionsTest-1623377801-project May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: ae021e81bd724b8085a2e384576946dc May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesActionsTest-1623377801-project May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 could not be found. May 23 20:30:53.262991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '8f09c58d-1cbe-468e-bf90-5b36935b7bc4'} May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 could not be found. May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:30:53.263923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 could not be found. May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 could not be found. May 23 20:30:53.265294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:30:53.266582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Returning 404 to user: Instance 8f09c58d-1cbe-468e-bf90-5b36935b7bc4 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:30:53.266582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-25b96b0b-9dd4-499d-8fe9-ec233c79fa49 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4" status: 404 len: 111 microversion: 2.1 time: 0.032632 May 23 20:30:53.266582 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 535/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:53 2022] GET /compute/v2.1/servers/8f09c58d-1cbe-468e-bf90-5b36935b7bc4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:30:53.372488 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1062588706", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "networks": [{"uuid": "919b7971-d637-4aef-92ae-1c5ac0e055d6"}]}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:53.430909 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] validate_networks() for [('919b7971-d637-4aef-92ae-1c5ac0e055d6', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:30:53.831092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:30:53.831511 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:30:53.831982 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:30:53.832585 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:30:53.833000 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:30:53.842501 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:53.843017 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:53.844164 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:53.845136 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:53.867460 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Getting quotas for project a656c669853f430a9a23e5568d1adb7a. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:30:53.867732 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Getting quotas for user ae021e81bd724b8085a2e384576946dc and project a656c669853f430a9a23e5568d1adb7a. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:30:53.879885 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:30:53.882355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:30:54.037933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-b01026a8-a972-41d1-91f4-96997b481d2a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669104 May 23 20:30:54.043732 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 513/1048] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:30:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:30:54.049032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e8cb81e9-dc92-412c-a2e0-64578d1ed862 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:54.049641 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e8cb81e9-dc92-412c-a2e0-64578d1ed862 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:54.119724 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e8cb81e9-dc92-412c-a2e0-64578d1ed862 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:54.122892 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e8cb81e9-dc92-412c-a2e0-64578d1ed862 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1214 microversion: 2.1 time: 0.077675 May 23 20:30:54.123479 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 536/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:54 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:54.312340 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-27373fb2-c3f7-4169-9f5c-6281894e191b req-27e1fc76-2aa4-4b99-ac61-e5ec89dd81b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd", "tag": "3da1951e-32c2-4a10-87c3-ed8bd6400eff"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:30:54.320876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-27373fb2-c3f7-4169-9f5c-6281894e191b req-27e1fc76-2aa4-4b99-ac61-e5ec89dd81b4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:54.321326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-27373fb2-c3f7-4169-9f5c-6281894e191b req-27e1fc76-2aa4-4b99-ac61-e5ec89dd81b4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:54.333214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-27373fb2-c3f7-4169-9f5c-6281894e191b req-27e1fc76-2aa4-4b99-ac61-e5ec89dd81b4 service nova] Creating event network-changed:3da1951e-32c2-4a10-87c3-ed8bd6400eff for instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd on hv-cinder-84301 May 23 20:30:54.338521 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-27373fb2-c3f7-4169-9f5c-6281894e191b req-27e1fc76-2aa4-4b99-ac61-e5ec89dd81b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030011 May 23 20:30:54.339555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 514/1050] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:30:55.139959 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:55.140567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:55.147833 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:55.148282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:55.149040 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:55.149476 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:55.211444 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:55.219975 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-75acfe77-4cb9-4887-991c-df83ab53eeb8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1218 microversion: 2.1 time: 0.083991 May 23 20:30:55.220669 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 537/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:55 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:56.237249 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:56.237949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:56.244835 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:56.245282 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:56.246072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:56.246510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:56.250500 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:56.308023 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:56.316013 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-85ba0047-fd63-47b4-8ac9-7c55f6457b3c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1218 microversion: 2.1 time: 0.082489 May 23 20:30:56.316577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 515/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:56 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:57.333731 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:57.334935 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:57.338375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:57.342324 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:57.343368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:57.344773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:57.345364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:57.420986 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:57.428690 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ae0e561c-5e61-4b8b-acba-7593540a10f8 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1210 microversion: 2.1 time: 0.099736 May 23 20:30:57.434181 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 538/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:57 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:58.448731 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:58.449442 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:58.451915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:30:58.456731 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:58.457184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:58.457967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:58.458467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:58.541538 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:58.557864 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-57a807d6-acfe-4a3a-a1b7-08f7565324f4 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1272 microversion: 2.1 time: 0.110663 May 23 20:30:58.557864 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 516/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:58 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:30:59.573633 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:30:59.574269 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:30:59.581893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:59.582368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:59.583136 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:30:59.583571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:30:59.714765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:30:59.722518 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-64ed1598-1e36-4751-892a-c9af1d56a703 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.153330 May 23 20:30:59.723083 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 539/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:30:59 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:00.740234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:00.740820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:00.747655 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:00.748096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:00.748852 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:00.749311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:00.962183 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:00.969898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-aa5a9efe-dc5d-44b9-b816-333d9cc101ef tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.234576 May 23 20:31:00.979699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 517/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:00 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:01.433476 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-501c86c8-4a7b-4e6b-91d3-5f60fdbd9913 req-c445ada2-8b24-46b5-9c43-d48b37e4815e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef23c0c3-2457-4596-af40-c2cadd04fdd3", "tag": "4a947873-25d5-4491-b019-501f32ce481f"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:31:01.442568 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-501c86c8-4a7b-4e6b-91d3-5f60fdbd9913 req-c445ada2-8b24-46b5-9c43-d48b37e4815e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:01.443013 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-501c86c8-4a7b-4e6b-91d3-5f60fdbd9913 req-c445ada2-8b24-46b5-9c43-d48b37e4815e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:01.454448 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-501c86c8-4a7b-4e6b-91d3-5f60fdbd9913 req-c445ada2-8b24-46b5-9c43-d48b37e4815e service nova] Creating event network-changed:4a947873-25d5-4491-b019-501f32ce481f for instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 on hv-cinder-84301 May 23 20:31:01.459641 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-501c86c8-4a7b-4e6b-91d3-5f60fdbd9913 req-c445ada2-8b24-46b5-9c43-d48b37e4815e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029906 May 23 20:31:01.460224 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 540/1057] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:31:01.987590 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:01.988197 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:01.995275 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:01.999412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:01.999412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:01.999412 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:02.206177 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:02.213840 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5133f875-4704-4150-b3e8-a4c1ea34e58c tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.230475 May 23 20:31:02.219040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 518/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:01 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:03.232181 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:03.232875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:03.239178 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:03.239617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:03.240364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:03.240792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:03.371430 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:03.379434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-22c9ffea-7ed6-40f1-aafc-9bfee2cc752a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.151846 May 23 20:31:03.379982 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 541/1059] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:03 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:04.396667 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:04.397276 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:04.399680 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:04.400375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:04.405152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:04.405592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:04.406396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:04.406828 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:04.544886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:04.554150 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-0510babb-2555-44ec-8366-5c1eaea80936 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.161719 May 23 20:31:04.555336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 519/1060] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:04 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:05.571558 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:05.572156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:05.574151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:05.579530 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:05.581030 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:05.581238 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:05.581676 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:05.714452 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:05.722807 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-89bba1a7-5d95-4e57-bb8b-0b212b6ad90e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.155344 May 23 20:31:05.731225 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 542/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:05 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:06.717880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-68ac6d3c-cc2b-446a-9e45-0b801e99b2ff req-3d1d28ac-7496-4005-afb2-f8cee2ea4e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef23c0c3-2457-4596-af40-c2cadd04fdd3", "name": "network-vif-plugged", "status": "completed", "tag": "4a947873-25d5-4491-b019-501f32ce481f"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:31:06.730170 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-68ac6d3c-cc2b-446a-9e45-0b801e99b2ff req-3d1d28ac-7496-4005-afb2-f8cee2ea4e39 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:06.730812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-68ac6d3c-cc2b-446a-9e45-0b801e99b2ff req-3d1d28ac-7496-4005-afb2-f8cee2ea4e39 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:06.741006 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:06.741621 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:06.747758 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-68ac6d3c-cc2b-446a-9e45-0b801e99b2ff req-3d1d28ac-7496-4005-afb2-f8cee2ea4e39 service nova] Creating event network-vif-plugged:4a947873-25d5-4491-b019-501f32ce481f for instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 on hv-cinder-84301 May 23 20:31:06.753186 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-68ac6d3c-cc2b-446a-9e45-0b801e99b2ff req-3d1d28ac-7496-4005-afb2-f8cee2ea4e39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040862 May 23 20:31:06.754087 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 520/1062] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:31:06.765980 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:06.766964 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:06.768100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:06.768884 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:06.963957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:06.974420 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1ed37369-6277-457e-9066-1833625e455f tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.238814 May 23 20:31:06.989141 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 543/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:06 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:31:07.327420 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f50a9628-d20c-478d-a15d-4752ed23440a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:31:07.328464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f50a9628-d20c-478d-a15d-4752ed23440a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:07.335300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f50a9628-d20c-478d-a15d-4752ed23440a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:07.335774 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f50a9628-d20c-478d-a15d-4752ed23440a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:07.336806 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f50a9628-d20c-478d-a15d-4752ed23440a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:07.336996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f50a9628-d20c-478d-a15d-4752ed23440a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:07.519331 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f50a9628-d20c-478d-a15d-4752ed23440a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/action" status: 202 len: 0 microversion: 2.1 time: 0.196010 May 23 20:31:07.524742 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 521/1064] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:31:07 2022] POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:31:07.527894 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:07.528505 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:07.534677 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:07.535128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:07.535879 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:07.536309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:07.680338 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:07.688315 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-41011210-32ac-4e87-b648-ff73158a9fa9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1752 microversion: 2.1 time: 0.164185 May 23 20:31:07.688869 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 544/1065] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:07 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:07.992695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:07.993398 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:07.999653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:08.000104 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:08.000898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:08.001333 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:08.155357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:08.162779 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5798b636-1ce3-4e24-b3d3-713ed07d64a9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.174853 May 23 20:31:08.163327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 522/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:07 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:08.707259 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:08.707899 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:08.714432 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:08.714882 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:08.715683 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:08.716402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:08.868081 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:08.876090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5c8d2e51-f80e-4856-af39-5f9bfc8c0a61 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1752 microversion: 2.1 time: 0.173885 May 23 20:31:08.876768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 545/1067] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:08 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:09.179353 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:09.180428 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:09.187378 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:09.187969 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:09.188987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:09.189519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:09.320718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:09.328614 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f9b65c4c-e30e-4bf6-ad59-79ef47f973bf tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.153064 May 23 20:31:09.329180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 523/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:09 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:31:09.893519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:09.894270 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:09.900812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:09.901371 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:09.902156 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:09.902591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:10.075702 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:10.084213 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1a0a35a3-7a0e-41e7-a5f8-421fc2ed1b77 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1752 microversion: 2.1 time: 0.194685 May 23 20:31:10.084787 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 546/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:09 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:10.348839 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:10.349581 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:10.356100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:10.356546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:10.358071 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:10.358514 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:10.488504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:10.495922 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ac13f2e6-8989-4f1d-a167-117c8d79ba28 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.152528 May 23 20:31:10.496567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 524/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:10 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:11.100793 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:11.101558 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:11.108791 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:11.109246 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:11.110272 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:11.110704 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:11.261863 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:11.270817 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0325dd29-dd0f-49fc-8c64-defbcc44f986 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1752 microversion: 2.1 time: 0.174016 May 23 20:31:11.271342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 547/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:11 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:11.512753 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:11.514258 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:11.521496 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:11.521949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:11.522836 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:11.523275 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:11.735698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:11.743699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-285acfb4-4c5c-47ef-bdeb-a90daa88bb50 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1314 microversion: 2.1 time: 0.234781 May 23 20:31:11.744262 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 525/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:11 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:31:12.288570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:12.289713 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:12.297465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:12.297831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:12.298607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:12.299722 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:12.447171 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:12.455713 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c6d80bda-d61a-4245-8870-1352ba0e9d00 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.170849 May 23 20:31:12.456267 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 548/1073] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:12 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:12.761386 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:12.761943 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:12.768825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:12.769278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:12.770104 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:12.770548 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:12.905286 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:12.912834 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-006ece13-8272-4fe8-9c4b-da8dd836bc1a tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1497 microversion: 2.1 time: 0.155496 May 23 20:31:12.913396 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 526/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:12 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:31:13.473260 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:13.474086 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:13.480820 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:13.481462 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:13.482264 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:13.482797 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:13.631299 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:13.639953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-347c2ca9-8642-4c96-9737-9fb0cae47996 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.171160 May 23 20:31:13.641116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 549/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:13 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:13.778880 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:13.779398 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:13.786499 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:13.786971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:13.787812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:13.788244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:13.813892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:31:14.104222 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f42dc5b2-7b02-4dce-a750-ccda32c0722e tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 204 len: 0 microversion: 2.1 time: 0.328945 May 23 20:31:14.105106 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 527/1076] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:31:13 2022] DELETE /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:31:14.116188 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:14.116826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:14.123230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:14.123516 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:14.124285 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:14.124732 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:14.288398 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:14.295978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-77cf2850-05cd-4810-a355-5c5dc36e17c9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1503 microversion: 2.1 time: 0.186584 May 23 20:31:14.296634 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 550/1077] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:14 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:14.657123 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:14.657835 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:14.663978 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:14.664430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:14.665192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:14.665630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:14.834820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:14.842850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-84661bb1-4384-4217-a8c9-147fe51a0253 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.189955 May 23 20:31:14.843605 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 528/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:14 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:15.312979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:15.313621 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:15.320281 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:15.320721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:15.321718 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:15.322180 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:15.453515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:15.461547 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f891d021-9851-42bb-bd46-ecf8cd2d5ab9 tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1503 microversion: 2.1 time: 0.152526 May 23 20:31:15.462125 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 551/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:15 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:15.867799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:15.867799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:15.875213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:15.877504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:15.881030 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:15.881482 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:16.091213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:16.094800 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:16.100060 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cf3906ff-93db-4607-b3d0-e93fa8f8c30e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.243037 May 23 20:31:16.100657 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 529/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:15 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:16.217942 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-ce8b1817-47f9-4ef5-8fa9-5bfb2f92774d req-abebb7c7-e63f-4a23-b942-2cef6710e718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef23c0c3-2457-4596-af40-c2cadd04fdd3", "name": "network-vif-deleted", "tag": "4a947873-25d5-4491-b019-501f32ce481f"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:31:16.227852 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ce8b1817-47f9-4ef5-8fa9-5bfb2f92774d req-abebb7c7-e63f-4a23-b942-2cef6710e718 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:16.228296 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-ce8b1817-47f9-4ef5-8fa9-5bfb2f92774d req-abebb7c7-e63f-4a23-b942-2cef6710e718 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:16.245034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-ce8b1817-47f9-4ef5-8fa9-5bfb2f92774d req-abebb7c7-e63f-4a23-b942-2cef6710e718 service nova] Creating event network-vif-deleted:4a947873-25d5-4491-b019-501f32ce481f for instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 on hv-cinder-84301 May 23 20:31:16.250631 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-ce8b1817-47f9-4ef5-8fa9-5bfb2f92774d req-abebb7c7-e63f-4a23-b942-2cef6710e718 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036382 May 23 20:31:16.251614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 552/1081] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:31:16.480799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:16.482089 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:16.488670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:16.489123 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:16.490464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:16.490916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:16.522388 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:16.523080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:16.523603 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lazy-loading 'fault' on Instance uuid ef23c0c3-2457-4596-af40-c2cadd04fdd3 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:31:16.571900 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae021e81bd724b8085a2e384576946dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a656c669853f430a9a23e5568d1adb7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:16.579756 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fcc6c4cd-8a8b-4388-94a8-9b64016d452b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 200 len: 1304 microversion: 2.1 time: 0.103956 May 23 20:31:16.580726 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 530/1082] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:16 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:17.118381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:17.119267 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:17.125659 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:17.126290 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:17.127147 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:17.127628 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:17.281219 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:17.285655 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:17.293410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d8f2acff-ebc2-4c0f-9a2b-bf42a6546961 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.178195 May 23 20:31:17.301410 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 553/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:17 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:17.596745 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:17.597355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] [instance: ef23c0c3-2457-4596-af40-c2cadd04fdd3] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:17.604367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:17.604810 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:17.605569 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:17.606006 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] HTTP exception thrown: Instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 could not be found. May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Request method failure captured: May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 HTTP/1.1 May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-7lsW2Vxjy5FLz4p8R3tYZcuaqylu-UcxrboeO424OCR3_fFydsVafAbxCsI9g7XD0LRVBeDPgAIEMQNqSICwRORdvTFda7yESKW454Atlf6QRHVrPZfYqSgD2Dy1dvSNHk6XBBKTImK9qxpKp4FzcuaKkxsXX9GnTy7vryr97jOJU May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: a656c669853f430a9a23e5568d1adb7a May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-VolumesActionsTest-1623377801 May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:31:17.635445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a656c669853f430a9a23e5568d1adb7a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a656c669853f430a9a23e5568d1adb7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a656c669853f430a9a23e5568d1adb7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a656c669853f430a9a23e5568d1adb7a"}]}] May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-VolumesActionsTest-1623377801 May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: a656c669853f430a9a23e5568d1adb7a May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-VolumesActionsTest-1623377801 May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-VolumesActionsTest-1623377801-project May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: ae021e81bd724b8085a2e384576946dc May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-VolumesActionsTest-1623377801-project May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 could not be found. May 23 20:31:17.637815 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': 'ef23c0c3-2457-4596-af40-c2cadd04fdd3'} May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 could not be found. May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:31:17.638674 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 could not be found. May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 could not be found. May 23 20:31:17.640152 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:31:17.641342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] Returning 404 to user: Instance ef23c0c3-2457-4596-af40-c2cadd04fdd3 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:31:17.641342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8d7ffd7b-3661-4a09-88f9-a9d556a1373b tempest-VolumesActionsTest-1623377801 tempest-VolumesActionsTest-1623377801-project] 10.222.0.16 "GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3" status: 404 len: 111 microversion: 2.1 time: 0.031196 May 23 20:31:17.641342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 531/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:17 2022] GET /compute/v2.1/servers/ef23c0c3-2457-4596-af40-c2cadd04fdd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:31:18.309496 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:18.310287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:18.316567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:18.317016 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:18.317771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:18.318234 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:18.472875 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:18.480854 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b5f8c0ba-f5ff-4d51-9d68-a89f819732f9 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.176180 May 23 20:31:18.481384 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 554/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:18 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:19.498155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:19.498772 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:19.505879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:19.506365 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:19.507189 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:19.507633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:19.656567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:19.665148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fcbd5118-55ab-4d92-82fe-8e6c01441f78 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.171290 May 23 20:31:19.665718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 532/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:19 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:20.682785 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:20.683396 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:20.690659 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:20.697772 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:20.697772 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:20.697772 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:20.893428 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:20.902449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-895a9561-a78f-4d87-9bdc-6122c7cdcc26 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.223480 May 23 20:31:20.906382 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 555/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:20 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:21.922997 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:21.923698 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:21.930277 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:21.930731 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:21.931526 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:21.931961 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:22.085050 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:22.093337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5d77dc21-2f8e-4c0b-b84b-212f63d1c1a0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.174286 May 23 20:31:22.093902 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 533/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:21 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:23.113981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:23.113981 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:23.118118 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:23.118645 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:23.119404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:23.119834 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:23.289364 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:23.297864 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-8960060c-6922-45d5-b50f-4e065d0540f2 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1757 microversion: 2.1 time: 0.191458 May 23 20:31:23.298465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 556/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:23 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:23.521491 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2019590577", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "networks": [{"uuid": "e8bec14f-5f2f-4971-9ffa-fd587de3b5b8"}]}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:31:23.579167 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.network.neutron [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] validate_networks() for [('e8bec14f-5f2f-4971-9ffa-fd587de3b5b8', None, None, None, None, None)] {{(pid=118171) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:31:23.996322 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Flavor limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:31:23.996659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Image limits 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:31:23.997336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Flavor pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:31:23.997933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Image pref 0:0:0 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:31:23.998378 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.virt.hardware [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118171) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:31:24.009434 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:24.010057 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:24.010863 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:24.011296 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:24.030689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Getting quotas for project fba86b652dc24d4784eb3caa4d3ed300. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:31:24.036442 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.quota [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Getting quotas for user 47e7f40810184611bfdd184a35dc26fc and project fba86b652dc24d4784eb3caa4d3ed300. Resources: {'ram', 'cores', 'instances'} {{(pid=118171) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:31:24.051093 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Going to run 1 instances... {{(pid=118171) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:31:24.053450 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118171) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:31:24.227659 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4985ed6b-c181-40a1-982d-e4c33332024a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710532 May 23 20:31:24.228505 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 534/1090] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:31:24.238868 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ac344dc9-58a1-4953-8e62-84b02075910d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:24.240326 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ac344dc9-58a1-4953-8e62-84b02075910d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:24.316069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:24.316997 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:24.327958 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ac344dc9-58a1-4953-8e62-84b02075910d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:24.328678 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:24.329336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:24.333436 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:24.334145 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:24.335880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ac344dc9-58a1-4953-8e62-84b02075910d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1219 microversion: 2.1 time: 0.101355 May 23 20:31:24.337896 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 557/1091] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:24 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:24.648421 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:24.666633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7b602027-7924-4017-9ed8-af4e6b0c96dd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1760 microversion: 2.1 time: 0.355148 May 23 20:31:24.667715 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 535/1092] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:24 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1760 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:31:25.367741 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c7cfd8f6-b3f2-4520-a06b-0b1fbb90ef9c tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:25.368445 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c7cfd8f6-b3f2-4520-a06b-0b1fbb90ef9c tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:25.459060 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c7cfd8f6-b3f2-4520-a06b-0b1fbb90ef9c tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:25.467577 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c7cfd8f6-b3f2-4520-a06b-0b1fbb90ef9c tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1219 microversion: 2.1 time: 0.110800 May 23 20:31:25.479722 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 558/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:25 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:26.485245 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:26.485898 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:26.497831 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:26.498513 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:26.499625 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:26.500424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:26.610128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:26.626282 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-fa25d7e9-6e95-421d-8fc1-e127db872b8e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1271 microversion: 2.1 time: 0.144204 May 23 20:31:26.627233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 536/1094] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:26 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:27.644094 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:27.650257 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:27.652130 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:27.652844 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:27.653619 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:27.654104 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:27.874550 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:27.897058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-92eb9b63-2c33-4f01-a276-aa4c07d00da4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.256604 May 23 20:31:27.907090 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 559/1095] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:27 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:28.845934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-78f558c4-6d16-4250-8d46-099f66a093ea req-afa78814-a8ca-4518-afff-cbf352e20043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30a1911a-62de-46bb-aff3-872e9f2f0a86", "tag": "8cab2ea6-541e-419e-a704-f4bb40220d62"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:31:28.864114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-78f558c4-6d16-4250-8d46-099f66a093ea req-afa78814-a8ca-4518-afff-cbf352e20043 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:28.868248 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-78f558c4-6d16-4250-8d46-099f66a093ea req-afa78814-a8ca-4518-afff-cbf352e20043 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:28.892619 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-78f558c4-6d16-4250-8d46-099f66a093ea req-afa78814-a8ca-4518-afff-cbf352e20043 service nova] Creating event network-changed:8cab2ea6-541e-419e-a704-f4bb40220d62 for instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 on hv-cinder-84301 May 23 20:31:28.905599 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-78f558c4-6d16-4250-8d46-099f66a093ea req-afa78814-a8ca-4518-afff-cbf352e20043 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063497 May 23 20:31:28.907035 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 537/1096] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:31:28.923404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:28.923404 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:28.930542 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:28.934795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:28.936201 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:28.936960 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:29.191667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:29.203414 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-5acd547d-c8be-40a6-9fb2-195644ba39b1 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.293738 May 23 20:31:29.214360 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 560/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:28 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:30.223074 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:30.223496 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:30.230435 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:30.230577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:30.231591 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:30.232207 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:30.427413 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:30.436810 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-872a200e-12e3-4685-95d7-41f6ff22932f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.219440 May 23 20:31:30.454530 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 538/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:30 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:31.457593 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:31.458716 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:31.461903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=50 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:31.467662 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:31.468302 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:31.469361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:31.469792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:31.659038 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:31.667651 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7f60dd74-9dc2-40e1-be71-11b6ae807918 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.216908 May 23 20:31:31.668797 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 561/1099] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:31 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:32.690733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:32.691559 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:32.694687 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:32.701276 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:32.702079 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:32.703605 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:32.704357 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:32.922265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:32.935059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2c5712ea-2959-44af-9daf-e7a0d7d97756 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.249377 May 23 20:31:32.935993 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 539/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:32 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:33.952725 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:33.956812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:33.964345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:33.964797 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:33.965765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:33.966223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:34.112649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:34.120237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7df89d29-edaa-45f7-8520-270911e8dc1f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.171455 May 23 20:31:34.126132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 562/1101] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:33 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:34.913111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-f4750062-82cf-445a-b479-e2ddcfa23a9e req-2647da83-6a61-401c-9f34-1fc26bfc4253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a1911a-62de-46bb-aff3-872e9f2f0a86", "name": "network-vif-plugged", "status": "completed", "tag": "8cab2ea6-541e-419e-a704-f4bb40220d62"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:31:34.917050 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:34.917743 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=6 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:34.924762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-f4750062-82cf-445a-b479-e2ddcfa23a9e req-2647da83-6a61-401c-9f34-1fc26bfc4253 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:34.925206 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-f4750062-82cf-445a-b479-e2ddcfa23a9e req-2647da83-6a61-401c-9f34-1fc26bfc4253 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:34.941206 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-f4750062-82cf-445a-b479-e2ddcfa23a9e req-2647da83-6a61-401c-9f34-1fc26bfc4253 service nova] Creating event network-vif-plugged:8cab2ea6-541e-419e-a704-f4bb40220d62 for instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 on hv-cinder-84301 May 23 20:31:34.947180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-f4750062-82cf-445a-b479-e2ddcfa23a9e req-2647da83-6a61-401c-9f34-1fc26bfc4253 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037759 May 23 20:31:34.947775 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 540/1102] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:31:35.137697 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:35.138421 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:35.148604 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:35.154602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:35.154602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:35.154602 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:35.333629 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:35.342831 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bb702b6c-e57e-4fb4-be82-5a12406008bb tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.209240 May 23 20:31:35.343482 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 563/1103] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:35 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:31:36.362230 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:36.363778 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:36.371574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:36.372101 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:36.372879 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:36.373321 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:36.508716 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:36.516896 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a2f820ca-44ea-420a-8754-aabc099684fa tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1319 microversion: 2.1 time: 0.159904 May 23 20:31:36.517567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 541/1104] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:36 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:31:37.535077 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:31:37.536305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:31:37.538425 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=4 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:31:37.543961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:37.544489 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:37.545251 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:31:37.545678 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:31:37.689047 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:31:37.697473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7d0178ca-463b-40d7-b0a9-5ee8b5488e9f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1508 microversion: 2.1 time: 0.166749 May 23 20:31:37.698061 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 564/1105] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:31:37 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:32:10.384080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e074a6f1-886d-4e09-9840-d4fc1b4db23b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "567b51c3-9dda-43c2-94c6-a79693330b73", "device": "/dev/sdb"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:32:10.385669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e074a6f1-886d-4e09-9840-d4fc1b4db23b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:10.387794 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=5 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:10.388789 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=58 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:10.393712 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e074a6f1-886d-4e09-9840-d4fc1b4db23b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:10.394245 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e074a6f1-886d-4e09-9840-d4fc1b4db23b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:10.401566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e074a6f1-886d-4e09-9840-d4fc1b4db23b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:10.401566 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e074a6f1-886d-4e09-9840-d4fc1b4db23b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:11.153184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e074a6f1-886d-4e09-9840-d4fc1b4db23b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "POST /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.773062 May 23 20:32:11.153959 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 542/1106] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:32:10 2022] POST /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86/os-volume_attachments => generated 194 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:16.404953 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1704280330"}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:32:16.405672 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:16.407562 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=7 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:16.408266 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=54 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:16.413056 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:16.413502 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:16.414287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:16.414721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:16.566252 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.network.security_group_api [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Removing security group b256790b-e2e2-4990-9bb8-c413ec567c72 from port 67a1ec00-9ca3-4f89-91f2-5e327a06d58b May 23 20:32:17.043275 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7bf444e8-12c8-48a6-94b9-b7de9ffdb05f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/action" status: 202 len: 0 microversion: 2.1 time: 0.642335 May 23 20:32:17.043862 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 565/1107] 10.222.0.16 () {60 vars in 1277 bytes} [Mon May 23 20:32:16 2022] POST /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:32:17.055900 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-07c941b5-8521-4754-af90-0235688372e3 req-973c33f9-beb5-406f-b7ec-57789ff9ace5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:32:17.081626 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-07c941b5-8521-4754-af90-0235688372e3 req-973c33f9-beb5-406f-b7ec-57789ff9ace5 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:17.082937 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-07c941b5-8521-4754-af90-0235688372e3 req-973c33f9-beb5-406f-b7ec-57789ff9ace5 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:17.109947 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-07c941b5-8521-4754-af90-0235688372e3 req-973c33f9-beb5-406f-b7ec-57789ff9ace5 service nova] Creating event network-changed:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:32:17.121013 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-07c941b5-8521-4754-af90-0235688372e3 req-973c33f9-beb5-406f-b7ec-57789ff9ace5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069628 May 23 20:32:17.122336 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 543/1108] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:18.437762 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:18.441151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:18.444668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:18.445548 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:18.446333 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:18.446768 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:18.529237 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lazy-loading 'services' on Instance uuid dd0514fc-e707-470d-aedc-d33f24833ff4 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:32:18.753750 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6ee55d59-fe6f-47ae-a1b3-57bb2e3ff7fc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments/813a19a1-edbc-4594-b7b0-51d41202057a" status: 202 len: 0 microversion: 2.1 time: 0.320610 May 23 20:32:18.754369 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 566/1109] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:32:18 2022] DELETE /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments/813a19a1-edbc-4594-b7b0-51d41202057a => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:32:18.764182 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-73e2c2af-7f4f-459e-b1f2-5a5fa7f7a4d5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:18.765185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-73e2c2af-7f4f-459e-b1f2-5a5fa7f7a4d5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:18.771446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73e2c2af-7f4f-459e-b1f2-5a5fa7f7a4d5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:18.771889 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73e2c2af-7f4f-459e-b1f2-5a5fa7f7a4d5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:18.772699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73e2c2af-7f4f-459e-b1f2-5a5fa7f7a4d5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:18.773072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-73e2c2af-7f4f-459e-b1f2-5a5fa7f7a4d5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:18.802297 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-73e2c2af-7f4f-459e-b1f2-5a5fa7f7a4d5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 May 23 20:32:18.807021 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 544/1110] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:18 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:19.135543 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-f9016351-732e-4737-becf-7253d93c7d12 req-bda54514-c4f4-44f0-9048-9e64e3996eda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:32:19.144826 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f9016351-732e-4737-becf-7253d93c7d12 req-bda54514-c4f4-44f0-9048-9e64e3996eda service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:19.145298 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f9016351-732e-4737-becf-7253d93c7d12 req-bda54514-c4f4-44f0-9048-9e64e3996eda service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:19.156004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-f9016351-732e-4737-becf-7253d93c7d12 req-bda54514-c4f4-44f0-9048-9e64e3996eda service nova] Creating event network-changed:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:32:19.160738 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-f9016351-732e-4737-becf-7253d93c7d12 req-bda54514-c4f4-44f0-9048-9e64e3996eda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029305 May 23 20:32:19.161316 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 567/1111] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:32:19.814831 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ccfacb6b-87c1-4031-b0e9-2db74e69265a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:19.815751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ccfacb6b-87c1-4031-b0e9-2db74e69265a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:19.822431 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ccfacb6b-87c1-4031-b0e9-2db74e69265a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:19.822876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ccfacb6b-87c1-4031-b0e9-2db74e69265a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:19.823633 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ccfacb6b-87c1-4031-b0e9-2db74e69265a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:19.824066 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ccfacb6b-87c1-4031-b0e9-2db74e69265a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:19.856797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ccfacb6b-87c1-4031-b0e9-2db74e69265a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 May 23 20:32:19.858202 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 545/1112] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:19 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:20.869560 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-6184ede9-e3b2-4b6e-af17-73c5c1cd33db tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:20.870575 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-6184ede9-e3b2-4b6e-af17-73c5c1cd33db tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:20.877289 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6184ede9-e3b2-4b6e-af17-73c5c1cd33db tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:20.877732 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6184ede9-e3b2-4b6e-af17-73c5c1cd33db tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:20.878506 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6184ede9-e3b2-4b6e-af17-73c5c1cd33db tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:20.878932 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-6184ede9-e3b2-4b6e-af17-73c5c1cd33db tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:20.906591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-6184ede9-e3b2-4b6e-af17-73c5c1cd33db tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041725 May 23 20:32:20.907139 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 568/1113] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:20 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:21.917910 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-97277418-0a91-4a36-a8e4-431dd23cc093 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:21.918885 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-97277418-0a91-4a36-a8e4-431dd23cc093 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:21.925400 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97277418-0a91-4a36-a8e4-431dd23cc093 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:21.925853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97277418-0a91-4a36-a8e4-431dd23cc093 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:21.926648 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97277418-0a91-4a36-a8e4-431dd23cc093 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:21.927084 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-97277418-0a91-4a36-a8e4-431dd23cc093 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:21.956275 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-97277418-0a91-4a36-a8e4-431dd23cc093 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042299 May 23 20:32:21.956829 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 546/1114] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:21 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:22.968312 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0ecdebe2-fcba-4271-a928-f25cc89c5341 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:22.969159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0ecdebe2-fcba-4271-a928-f25cc89c5341 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:22.975553 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ecdebe2-fcba-4271-a928-f25cc89c5341 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:22.975988 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ecdebe2-fcba-4271-a928-f25cc89c5341 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:22.976734 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ecdebe2-fcba-4271-a928-f25cc89c5341 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:22.977160 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0ecdebe2-fcba-4271-a928-f25cc89c5341 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:23.005064 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0ecdebe2-fcba-4271-a928-f25cc89c5341 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041345 May 23 20:32:23.005608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 569/1115] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:22 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:24.016677 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f38d1975-7dc3-41a2-8dce-2f091ea00854 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:24.017605 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f38d1975-7dc3-41a2-8dce-2f091ea00854 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:24.024134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f38d1975-7dc3-41a2-8dce-2f091ea00854 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:24.024592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f38d1975-7dc3-41a2-8dce-2f091ea00854 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:24.025356 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f38d1975-7dc3-41a2-8dce-2f091ea00854 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:24.025791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f38d1975-7dc3-41a2-8dce-2f091ea00854 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:24.054211 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f38d1975-7dc3-41a2-8dce-2f091ea00854 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041463 May 23 20:32:24.054761 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 547/1116] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:24 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:25.065934 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b6dbc723-0e0c-4512-82e5-c340e8533593 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:25.066915 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b6dbc723-0e0c-4512-82e5-c340e8533593 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:25.074403 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6dbc723-0e0c-4512-82e5-c340e8533593 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:25.075880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6dbc723-0e0c-4512-82e5-c340e8533593 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:25.075880 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6dbc723-0e0c-4512-82e5-c340e8533593 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:25.076139 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b6dbc723-0e0c-4512-82e5-c340e8533593 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:25.105658 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b6dbc723-0e0c-4512-82e5-c340e8533593 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 May 23 20:32:25.106239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 570/1117] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:25 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:26.117250 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-906d18aa-a887-4474-88b9-edb72a56b93e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:26.118232 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-906d18aa-a887-4474-88b9-edb72a56b93e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:26.124599 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-906d18aa-a887-4474-88b9-edb72a56b93e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:26.125047 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-906d18aa-a887-4474-88b9-edb72a56b93e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:26.125807 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-906d18aa-a887-4474-88b9-edb72a56b93e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:26.126275 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-906d18aa-a887-4474-88b9-edb72a56b93e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:26.155434 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-906d18aa-a887-4474-88b9-edb72a56b93e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042188 May 23 20:32:26.155974 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 548/1118] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:26 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:27.166592 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e40af58b-9f16-4257-8c3c-6a400dfb6f9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:27.168134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e40af58b-9f16-4257-8c3c-6a400dfb6f9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:27.174709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e40af58b-9f16-4257-8c3c-6a400dfb6f9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:27.175157 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e40af58b-9f16-4257-8c3c-6a400dfb6f9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:27.175906 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e40af58b-9f16-4257-8c3c-6a400dfb6f9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:27.176338 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e40af58b-9f16-4257-8c3c-6a400dfb6f9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:27.203936 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e40af58b-9f16-4257-8c3c-6a400dfb6f9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041332 May 23 20:32:27.204473 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 571/1119] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:27 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:28.215534 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4db65525-c818-4c08-b4c7-0626f74b848f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:28.216384 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4db65525-c818-4c08-b4c7-0626f74b848f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:28.222933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4db65525-c818-4c08-b4c7-0626f74b848f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:28.223379 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4db65525-c818-4c08-b4c7-0626f74b848f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:28.224141 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4db65525-c818-4c08-b4c7-0626f74b848f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:28.224573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4db65525-c818-4c08-b4c7-0626f74b848f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:28.253547 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4db65525-c818-4c08-b4c7-0626f74b848f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 May 23 20:32:28.254099 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 549/1120] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:28 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:29.265585 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ac1cbf89-03ba-4089-a963-249de0fdc3c0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:29.266540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ac1cbf89-03ba-4089-a963-249de0fdc3c0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:29.273253 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ac1cbf89-03ba-4089-a963-249de0fdc3c0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:29.273698 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ac1cbf89-03ba-4089-a963-249de0fdc3c0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:29.274488 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ac1cbf89-03ba-4089-a963-249de0fdc3c0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:29.274924 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ac1cbf89-03ba-4089-a963-249de0fdc3c0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:29.303392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ac1cbf89-03ba-4089-a963-249de0fdc3c0 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042345 May 23 20:32:29.303931 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 572/1121] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:29 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:30.314894 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9ff37376-1776-44d2-969f-10cba146762d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:30.315860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9ff37376-1776-44d2-969f-10cba146762d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:30.322623 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9ff37376-1776-44d2-969f-10cba146762d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:30.323070 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9ff37376-1776-44d2-969f-10cba146762d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:30.323848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9ff37376-1776-44d2-969f-10cba146762d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:30.324286 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9ff37376-1776-44d2-969f-10cba146762d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:30.352430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9ff37376-1776-44d2-969f-10cba146762d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041487 May 23 20:32:30.352971 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 550/1122] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:30 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:31.364477 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b9f17cf6-4710-41c0-a2bd-b2029c71dc97 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:31.365402 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b9f17cf6-4710-41c0-a2bd-b2029c71dc97 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:31.371843 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b9f17cf6-4710-41c0-a2bd-b2029c71dc97 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:31.372287 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b9f17cf6-4710-41c0-a2bd-b2029c71dc97 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:31.373041 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b9f17cf6-4710-41c0-a2bd-b2029c71dc97 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:31.373471 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b9f17cf6-4710-41c0-a2bd-b2029c71dc97 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:31.403614 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b9f17cf6-4710-41c0-a2bd-b2029c71dc97 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 May 23 20:32:31.404149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 573/1123] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:31 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:32.414128 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ca64cf41-7acc-415a-aca2-0bdf18b10d3c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:32.415056 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ca64cf41-7acc-415a-aca2-0bdf18b10d3c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:32.422244 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ca64cf41-7acc-415a-aca2-0bdf18b10d3c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:32.422694 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ca64cf41-7acc-415a-aca2-0bdf18b10d3c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:32.423452 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ca64cf41-7acc-415a-aca2-0bdf18b10d3c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:32.423892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ca64cf41-7acc-415a-aca2-0bdf18b10d3c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:32.451874 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ca64cf41-7acc-415a-aca2-0bdf18b10d3c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 May 23 20:32:32.452417 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 551/1124] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:32 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:33.463373 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-44febf67-09bf-4057-9b53-30b023566f37 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:33.464309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-44febf67-09bf-4057-9b53-30b023566f37 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:33.470726 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-44febf67-09bf-4057-9b53-30b023566f37 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:33.471165 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-44febf67-09bf-4057-9b53-30b023566f37 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:33.471913 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-44febf67-09bf-4057-9b53-30b023566f37 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:33.472335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-44febf67-09bf-4057-9b53-30b023566f37 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:33.502002 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-44febf67-09bf-4057-9b53-30b023566f37 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 May 23 20:32:33.502809 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 574/1125] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:33 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:34.370582 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:34.371093 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:34.373571 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-f2703f1d-331c-43b1-a4b4-b4a132490567 req-ff1f771b-3cfb-45e3-bd5b-241f988a1c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd", "tag": "3da1951e-32c2-4a10-87c3-ed8bd6400eff"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:32:34.381720 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f2703f1d-331c-43b1-a4b4-b4a132490567 req-ff1f771b-3cfb-45e3-bd5b-241f988a1c6d service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:34.382420 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-f2703f1d-331c-43b1-a4b4-b4a132490567 req-ff1f771b-3cfb-45e3-bd5b-241f988a1c6d service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:34.389665 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:34.390155 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:34.390926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:34.391366 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:34.394264 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-f2703f1d-331c-43b1-a4b4-b4a132490567 req-ff1f771b-3cfb-45e3-bd5b-241f988a1c6d service nova] Creating event network-changed:3da1951e-32c2-4a10-87c3-ed8bd6400eff for instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd on hv-cinder-84301 May 23 20:32:34.407127 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-f2703f1d-331c-43b1-a4b4-b4a132490567 req-ff1f771b-3cfb-45e3-bd5b-241f988a1c6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036988 May 23 20:32:34.408151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 575/1126] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:34.417991 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:32:34.514682 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d9e106a4-69b1-4a09-9710-48c413f38d9e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:34.515771 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d9e106a4-69b1-4a09-9710-48c413f38d9e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:34.521912 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9e106a4-69b1-4a09-9710-48c413f38d9e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:34.522386 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9e106a4-69b1-4a09-9710-48c413f38d9e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:34.523175 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9e106a4-69b1-4a09-9710-48c413f38d9e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:34.523779 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d9e106a4-69b1-4a09-9710-48c413f38d9e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:34.553506 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d9e106a4-69b1-4a09-9710-48c413f38d9e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 May 23 20:32:34.554107 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 576/1127] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:34 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:32:34.691242 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5fbb8db3-c226-460b-8890-613e1aeec490 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 204 len: 0 microversion: 2.1 time: 0.324214 May 23 20:32:34.691848 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 552/1128] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:32:34 2022] DELETE /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:32:34.700836 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:34.701457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:34.710624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:34.710624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:34.710624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:34.710624 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:34.842980 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:34.850903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-ee61b22e-5d8c-48f3-bea9-06f923e25676 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.154672 May 23 20:32:34.851657 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 577/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:34 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:35.565251 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-30305f69-ce54-4a0b-8ebb-828635ea6d50 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:35.566294 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-30305f69-ce54-4a0b-8ebb-828635ea6d50 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:35.572926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30305f69-ce54-4a0b-8ebb-828635ea6d50 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:35.573420 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30305f69-ce54-4a0b-8ebb-828635ea6d50 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:35.574210 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30305f69-ce54-4a0b-8ebb-828635ea6d50 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:35.574644 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-30305f69-ce54-4a0b-8ebb-828635ea6d50 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:35.604228 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-30305f69-ce54-4a0b-8ebb-828635ea6d50 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 May 23 20:32:35.605355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 553/1130] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:35 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:35.867949 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:35.868515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:35.875046 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:35.875489 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:35.876242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:35.876671 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:36.005873 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:36.013830 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b5e7a234-2f4d-4194-9cf2-e5326e421090 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.149761 May 23 20:32:36.014466 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 578/1131] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:35 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:36.615374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5f75c268-9ba3-4787-a523-23b8837a2cf8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:36.616310 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5f75c268-9ba3-4787-a523-23b8837a2cf8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:36.623438 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f75c268-9ba3-4787-a523-23b8837a2cf8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:36.623892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f75c268-9ba3-4787-a523-23b8837a2cf8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:36.624658 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f75c268-9ba3-4787-a523-23b8837a2cf8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:36.625098 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5f75c268-9ba3-4787-a523-23b8837a2cf8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:36.652812 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5f75c268-9ba3-4787-a523-23b8837a2cf8 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041355 May 23 20:32:36.653346 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 554/1132] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:36 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:37.032569 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:37.033093 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:37.039509 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:37.044617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:37.044617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:37.044617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:37.168833 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:37.176434 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2ca5b830-96bf-42d8-8841-2cba2f229e71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.147790 May 23 20:32:37.176998 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 579/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:37 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:37.664207 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2e62bb46-f130-486d-8d5b-a86427f5f7de tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:37.665058 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2e62bb46-f130-486d-8d5b-a86427f5f7de tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:37.671777 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e62bb46-f130-486d-8d5b-a86427f5f7de tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:37.672218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e62bb46-f130-486d-8d5b-a86427f5f7de tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:37.672987 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e62bb46-f130-486d-8d5b-a86427f5f7de tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:37.673419 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2e62bb46-f130-486d-8d5b-a86427f5f7de tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:37.702919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2e62bb46-f130-486d-8d5b-a86427f5f7de tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042657 May 23 20:32:37.703464 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 555/1134] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:37 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:38.193483 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:38.194079 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:38.200977 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:38.201449 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:38.202249 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:38.202684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:38.335527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:38.343570 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c9bca95f-1f2c-42dd-99f5-37538e934b1b tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.154022 May 23 20:32:38.344166 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 580/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:38 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:38.714809 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-d032011c-d12a-4fa9-998e-f086584659e5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:38.715733 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-d032011c-d12a-4fa9-998e-f086584659e5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:38.722142 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d032011c-d12a-4fa9-998e-f086584659e5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:38.722593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d032011c-d12a-4fa9-998e-f086584659e5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:38.723350 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d032011c-d12a-4fa9-998e-f086584659e5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:38.723785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-d032011c-d12a-4fa9-998e-f086584659e5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:38.727538 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:38.751670 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-d032011c-d12a-4fa9-998e-f086584659e5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041363 May 23 20:32:38.752206 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 556/1136] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:38 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:39.360386 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:39.360994 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:39.367484 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:39.367922 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:39.368672 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:39.369097 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:39.497490 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:39.504904 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-81aae1bf-4d6b-450f-aff9-ceeeb9789750 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.148358 May 23 20:32:39.505460 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 581/1137] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:39 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:39.763116 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-980123bd-5259-4e00-96af-7495fcbe518d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:39.763975 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-980123bd-5259-4e00-96af-7495fcbe518d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:39.770998 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-980123bd-5259-4e00-96af-7495fcbe518d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:39.771446 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-980123bd-5259-4e00-96af-7495fcbe518d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:39.772205 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-980123bd-5259-4e00-96af-7495fcbe518d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:39.772636 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-980123bd-5259-4e00-96af-7495fcbe518d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:39.801707 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-980123bd-5259-4e00-96af-7495fcbe518d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 May 23 20:32:39.802272 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 557/1138] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:39 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:40.521705 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:40.522273 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:40.529153 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:40.529591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:40.530376 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:40.530799 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:40.548119 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:40.657607 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:40.664997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b97446a9-5cbb-4c1d-b3e4-6e1ea0683eb6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.147139 May 23 20:32:40.665567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 582/1139] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:40 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:40.814316 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2b58fbbb-042e-4f83-ad71-c006835a7e69 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:40.815176 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2b58fbbb-042e-4f83-ad71-c006835a7e69 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:40.817431 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:40.822672 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b58fbbb-042e-4f83-ad71-c006835a7e69 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:40.826624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b58fbbb-042e-4f83-ad71-c006835a7e69 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:40.826624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b58fbbb-042e-4f83-ad71-c006835a7e69 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:40.826624 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2b58fbbb-042e-4f83-ad71-c006835a7e69 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:40.853550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2b58fbbb-042e-4f83-ad71-c006835a7e69 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 May 23 20:32:40.855445 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 558/1140] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:40 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:41.680992 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:41.681610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:41.688151 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:41.690649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:41.690649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:41.690649 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:41.822952 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:41.831014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-46e6a703-20a7-4822-8cd0-16b861c77ccc tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.153951 May 23 20:32:41.831574 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 583/1141] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:41 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:41.865027 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-78ee25e1-2766-48b1-8741-fd2418b345bc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:41.865952 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-78ee25e1-2766-48b1-8741-fd2418b345bc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:41.872932 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78ee25e1-2766-48b1-8741-fd2418b345bc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:41.873375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78ee25e1-2766-48b1-8741-fd2418b345bc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:41.874150 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78ee25e1-2766-48b1-8741-fd2418b345bc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:41.874580 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-78ee25e1-2766-48b1-8741-fd2418b345bc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:41.903062 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-78ee25e1-2766-48b1-8741-fd2418b345bc tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042278 May 23 20:32:41.903594 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 559/1142] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:41 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:42.847754 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:42.848365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:42.854821 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:42.855821 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:42.856585 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:42.857017 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:42.914760 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-217ea82d-b8bd-4d35-899f-7a4cb2fed48b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:42.915689 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-217ea82d-b8bd-4d35-899f-7a4cb2fed48b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:42.922860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-217ea82d-b8bd-4d35-899f-7a4cb2fed48b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:42.923313 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-217ea82d-b8bd-4d35-899f-7a4cb2fed48b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:42.924077 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-217ea82d-b8bd-4d35-899f-7a4cb2fed48b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:42.924516 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-217ea82d-b8bd-4d35-899f-7a4cb2fed48b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:42.953875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-217ea82d-b8bd-4d35-899f-7a4cb2fed48b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043127 May 23 20:32:42.954457 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 560/1143] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:42 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:42.989049 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:42.996636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-46a1a9cf-f5de-4187-b120-cdb7886a1f71 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.152677 May 23 20:32:42.997191 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 584/1144] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:42 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:43.965329 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-af68c058-d595-4e7b-914f-73a76208811e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:43.966271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-af68c058-d595-4e7b-914f-73a76208811e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:43.972891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-af68c058-d595-4e7b-914f-73a76208811e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:43.973343 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-af68c058-d595-4e7b-914f-73a76208811e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:43.974138 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-af68c058-d595-4e7b-914f-73a76208811e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:43.974574 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-af68c058-d595-4e7b-914f-73a76208811e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:44.004193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-af68c058-d595-4e7b-914f-73a76208811e tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 May 23 20:32:44.004742 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 561/1145] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:43 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:44.013036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:44.013643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:44.020282 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:44.020731 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:44.021488 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:44.021923 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:44.156221 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:44.164016 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-83e0c08c-59ee-4749-a1ef-a977bff13de5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.154888 May 23 20:32:44.164581 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 585/1146] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:44 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:45.003875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-9acf9b00-bcb8-42a3-aa6a-b1e5343ad275 req-794266ee-2eae-4651-b324-d414558928c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd", "name": "network-vif-unplugged", "status": "completed", "tag": "3da1951e-32c2-4a10-87c3-ed8bd6400eff"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:32:45.014397 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-9acf9b00-bcb8-42a3-aa6a-b1e5343ad275 req-794266ee-2eae-4651-b324-d414558928c4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:45.016958 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-9acf9b00-bcb8-42a3-aa6a-b1e5343ad275 req-794266ee-2eae-4651-b324-d414558928c4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:45.017085 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-dfef8f52-e891-4cc1-b525-4d4e394432a4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:45.017085 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-dfef8f52-e891-4cc1-b525-4d4e394432a4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:45.023523 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dfef8f52-e891-4cc1-b525-4d4e394432a4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:45.024004 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dfef8f52-e891-4cc1-b525-4d4e394432a4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:45.024707 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dfef8f52-e891-4cc1-b525-4d4e394432a4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:45.025145 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-dfef8f52-e891-4cc1-b525-4d4e394432a4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:45.026430 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-9acf9b00-bcb8-42a3-aa6a-b1e5343ad275 req-794266ee-2eae-4651-b324-d414558928c4 service nova] Creating event network-vif-unplugged:3da1951e-32c2-4a10-87c3-ed8bd6400eff for instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd on hv-cinder-84301 May 23 20:32:45.032609 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-9acf9b00-bcb8-42a3-aa6a-b1e5343ad275 req-794266ee-2eae-4651-b324-d414558928c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032578 May 23 20:32:45.033239 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 562/1147] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:45.055872 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-dfef8f52-e891-4cc1-b525-4d4e394432a4 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 May 23 20:32:45.056436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 586/1148] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:45 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:32:45.181675 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:45.182345 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:45.189192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:45.189643 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:45.190448 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:45.190887 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:45.327431 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:45.335134 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e7ace039-c442-4917-b480-d2a451c04654 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.157832 May 23 20:32:45.335695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 563/1149] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:45 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:46.068019 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-4155d075-a100-444e-b2e5-12dacd21ef51 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:46.068961 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-4155d075-a100-444e-b2e5-12dacd21ef51 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:46.075486 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4155d075-a100-444e-b2e5-12dacd21ef51 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:46.078113 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4155d075-a100-444e-b2e5-12dacd21ef51 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:46.078113 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4155d075-a100-444e-b2e5-12dacd21ef51 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:46.078113 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-4155d075-a100-444e-b2e5-12dacd21ef51 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:46.107016 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-4155d075-a100-444e-b2e5-12dacd21ef51 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 May 23 20:32:46.107594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 587/1150] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:46 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:46.352377 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:46.352989 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:46.359653 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:46.360100 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:46.361098 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:46.361694 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:46.490851 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:46.498524 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cd32ea64-4433-40b1-9123-bf3e66873702 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.149879 May 23 20:32:46.499742 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 564/1151] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:46 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:47.118957 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0b9424a6-5703-4a14-9cc7-0fa41e4abdbf tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:47.119926 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0b9424a6-5703-4a14-9cc7-0fa41e4abdbf tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:47.123149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=47 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:47.128425 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b9424a6-5703-4a14-9cc7-0fa41e4abdbf tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:47.128936 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b9424a6-5703-4a14-9cc7-0fa41e4abdbf tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:47.129770 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b9424a6-5703-4a14-9cc7-0fa41e4abdbf tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:47.130222 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b9424a6-5703-4a14-9cc7-0fa41e4abdbf tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:47.162610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0b9424a6-5703-4a14-9cc7-0fa41e4abdbf tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 May 23 20:32:47.163199 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 588/1152] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:47 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:47.516218 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:47.516740 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:47.522956 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:47.523402 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:47.524159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:47.524592 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:47.652488 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:47.659947 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-802aedcb-b1ff-4828-99ed-a06768be2151 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.147697 May 23 20:32:47.660510 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 565/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:47 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:48.174070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-150400f9-f32e-4f72-882b-79c76cd03a9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:48.174988 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-150400f9-f32e-4f72-882b-79c76cd03a9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:48.181535 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-150400f9-f32e-4f72-882b-79c76cd03a9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:48.181916 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-150400f9-f32e-4f72-882b-79c76cd03a9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:48.182696 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-150400f9-f32e-4f72-882b-79c76cd03a9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:48.183610 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-150400f9-f32e-4f72-882b-79c76cd03a9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:48.213495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-150400f9-f32e-4f72-882b-79c76cd03a9d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 May 23 20:32:48.214072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 589/1154] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:48 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:48.676673 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:48.677391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:48.684521 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:48.684967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:48.685718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:48.686195 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:48.814451 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:48.822141 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1fe8f16c-5ac4-400c-81a8-f26ae929bc36 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.149401 May 23 20:32:48.822724 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 566/1155] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:48 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:49.225092 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3c8a287b-f6f4-44d7-ab53-c93315e08b0c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:49.225682 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3c8a287b-f6f4-44d7-ab53-c93315e08b0c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:49.232072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c8a287b-f6f4-44d7-ab53-c93315e08b0c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:49.240368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c8a287b-f6f4-44d7-ab53-c93315e08b0c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:49.240368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c8a287b-f6f4-44d7-ab53-c93315e08b0c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:49.240368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3c8a287b-f6f4-44d7-ab53-c93315e08b0c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:49.261674 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3c8a287b-f6f4-44d7-ab53-c93315e08b0c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040363 May 23 20:32:49.263412 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 590/1156] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:49 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:49.839208 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:49.839791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:49.846266 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:49.846713 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:49.847467 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:49.847895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:49.980262 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:49.987803 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7ed17a5b-0a9a-4086-9429-2216bd0d6c54 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.152494 May 23 20:32:49.988359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 567/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:49 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:32:50.272655 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e62e9ec6-e688-47b8-8e2a-6086f318f9bb tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:50.273574 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e62e9ec6-e688-47b8-8e2a-6086f318f9bb tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:50.280763 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e62e9ec6-e688-47b8-8e2a-6086f318f9bb tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:50.281207 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e62e9ec6-e688-47b8-8e2a-6086f318f9bb tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:50.281956 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e62e9ec6-e688-47b8-8e2a-6086f318f9bb tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:50.282414 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e62e9ec6-e688-47b8-8e2a-6086f318f9bb tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:50.310596 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e62e9ec6-e688-47b8-8e2a-6086f318f9bb tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041852 May 23 20:32:50.311135 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 591/1158] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:50 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:51.005570 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:51.006213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:51.013248 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:51.013692 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:51.014476 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:51.014910 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:51.322471 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-20cfa126-0402-4b92-9885-9e175ad8571d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:51.323580 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-20cfa126-0402-4b92-9885-9e175ad8571d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:51.330825 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20cfa126-0402-4b92-9885-9e175ad8571d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:51.331262 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20cfa126-0402-4b92-9885-9e175ad8571d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:51.332032 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20cfa126-0402-4b92-9885-9e175ad8571d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:51.332437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-20cfa126-0402-4b92-9885-9e175ad8571d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:51.360803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-20cfa126-0402-4b92-9885-9e175ad8571d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 May 23 20:32:51.361368 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 592/1159] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:51 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:32:51.403433 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:51.410875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e267b4c8-8127-4fb9-8fdf-4c71e892d31a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.409180 May 23 20:32:51.411443 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 568/1160] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:51 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:52.372202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d2414b29-636f-4149-8472-a85243a46738 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:52.373114 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d2414b29-636f-4149-8472-a85243a46738 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:52.379436 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d2414b29-636f-4149-8472-a85243a46738 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:52.379889 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d2414b29-636f-4149-8472-a85243a46738 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:52.380623 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d2414b29-636f-4149-8472-a85243a46738 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:52.381046 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d2414b29-636f-4149-8472-a85243a46738 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:52.409663 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d2414b29-636f-4149-8472-a85243a46738 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041327 May 23 20:32:52.410236 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 593/1161] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:52 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:52.428551 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:52.429163 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:52.435615 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:52.436095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:52.436887 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:52.437327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:52.563251 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:52.570945 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a4af3e0f-bb4b-426e-826d-4ce3077dcb16 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.146282 May 23 20:32:52.571509 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 569/1162] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:52 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:53.421327 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-48d587a0-86a6-4e42-bbcf-0a58d16b2f0f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:53.422289 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-48d587a0-86a6-4e42-bbcf-0a58d16b2f0f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:53.428736 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48d587a0-86a6-4e42-bbcf-0a58d16b2f0f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:53.429183 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48d587a0-86a6-4e42-bbcf-0a58d16b2f0f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:53.429941 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48d587a0-86a6-4e42-bbcf-0a58d16b2f0f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:53.430401 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-48d587a0-86a6-4e42-bbcf-0a58d16b2f0f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:53.458342 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-48d587a0-86a6-4e42-bbcf-0a58d16b2f0f tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041614 May 23 20:32:53.458885 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 594/1163] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:53 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:53.588748 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:53.589359 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:53.596418 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:53.596873 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:53.597630 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:53.598088 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:53.729607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:53.737113 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-bad8f630-01cc-45d6-8cb9-698c9b9911d7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.152255 May 23 20:32:53.737675 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 570/1164] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:53 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:54.469393 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-7f5c709e-3052-406d-b0db-33f5601a989a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:54.470337 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-7f5c709e-3052-406d-b0db-33f5601a989a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:54.476811 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f5c709e-3052-406d-b0db-33f5601a989a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:54.477205 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f5c709e-3052-406d-b0db-33f5601a989a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:54.477949 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f5c709e-3052-406d-b0db-33f5601a989a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:54.478409 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-7f5c709e-3052-406d-b0db-33f5601a989a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:54.507392 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-7f5c709e-3052-406d-b0db-33f5601a989a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 May 23 20:32:54.507928 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 595/1165] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:54 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:54.753967 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:54.754541 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:54.760999 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:54.761440 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:54.762233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:54.762669 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:54.889205 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:54.896747 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-50fa473c-cbe5-441e-ad7a-bfeb82fd2439 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.146684 May 23 20:32:54.897306 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 571/1166] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:54 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:55.519298 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-30a3fee1-02c2-4df2-8769-2f70f0e3fc6c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:55.520218 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-30a3fee1-02c2-4df2-8769-2f70f0e3fc6c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:55.526709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30a3fee1-02c2-4df2-8769-2f70f0e3fc6c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:55.527157 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30a3fee1-02c2-4df2-8769-2f70f0e3fc6c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:55.527914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30a3fee1-02c2-4df2-8769-2f70f0e3fc6c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:55.528345 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-30a3fee1-02c2-4df2-8769-2f70f0e3fc6c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:55.555862 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-30a3fee1-02c2-4df2-8769-2f70f0e3fc6c tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040496 May 23 20:32:55.556407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 596/1167] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:55 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:55.914355 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:55.914962 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:55.921867 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:55.922337 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:55.923093 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:55.923525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:56.055266 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:56.063262 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-5c93e999-14ca-4061-b85a-2c691bd88347 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.152813 May 23 20:32:56.063935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 572/1168] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:55 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:56.566893 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-030516a6-2b46-4071-b202-7be7a9768e71 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:56.567827 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-030516a6-2b46-4071-b202-7be7a9768e71 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:56.574495 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-030516a6-2b46-4071-b202-7be7a9768e71 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:56.574935 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-030516a6-2b46-4071-b202-7be7a9768e71 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:56.575708 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-030516a6-2b46-4071-b202-7be7a9768e71 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:56.576133 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-030516a6-2b46-4071-b202-7be7a9768e71 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:56.604457 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-030516a6-2b46-4071-b202-7be7a9768e71 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041473 May 23 20:32:56.604997 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 597/1169] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:56 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:57.081299 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:57.081897 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:57.088585 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:57.089034 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:57.089827 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:57.090410 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:57.108478 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=100 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:57.218193 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:57.225843 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6a6bbb1b-6c81-4620-9e1d-bbe6a525175d tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.148412 May 23 20:32:57.226451 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 573/1170] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:57 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:57.616715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-b1211520-2c88-4f59-a336-2c26625dccaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:57.617675 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-b1211520-2c88-4f59-a336-2c26625dccaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:57.624749 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b1211520-2c88-4f59-a336-2c26625dccaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:57.625197 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b1211520-2c88-4f59-a336-2c26625dccaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:57.625951 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b1211520-2c88-4f59-a336-2c26625dccaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:57.626406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-b1211520-2c88-4f59-a336-2c26625dccaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:57.653785 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-b1211520-2c88-4f59-a336-2c26625dccaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041433 May 23 20:32:57.654365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 598/1171] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:57 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:58.243095 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:58.243702 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:58.250687 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:58.251135 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:58.251891 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:58.252327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:58.532661 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:58.540173 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2d31ef19-3d57-4fba-9b5e-a08d8cc561c5 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.300978 May 23 20:32:58.540734 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 574/1172] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:58 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:58.665062 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0f585f21-d924-47b6-9f3c-de4d77c26085 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:58.665978 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0f585f21-d924-47b6-9f3c-de4d77c26085 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:58.672984 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f585f21-d924-47b6-9f3c-de4d77c26085 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:58.673423 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f585f21-d924-47b6-9f3c-de4d77c26085 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:58.674210 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f585f21-d924-47b6-9f3c-de4d77c26085 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:58.674640 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0f585f21-d924-47b6-9f3c-de4d77c26085 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:58.678204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=100 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:32:58.703102 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0f585f21-d924-47b6-9f3c-de4d77c26085 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041881 May 23 20:32:58.703642 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 599/1173] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:58 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:32:59.557625 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:59.558189 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:59.564688 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:59.565136 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:59.565929 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:59.566388 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:59.695507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:32:59.703557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-56f47b63-2cc7-4982-a070-af6f85534edd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.149925 May 23 20:32:59.704103 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 575/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:32:59 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:32:59.713991 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c41a1314-9d95-41a3-a6e4-499eed42608a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:32:59.715098 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c41a1314-9d95-41a3-a6e4-499eed42608a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:32:59.721822 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c41a1314-9d95-41a3-a6e4-499eed42608a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:59.722306 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c41a1314-9d95-41a3-a6e4-499eed42608a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:59.723060 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c41a1314-9d95-41a3-a6e4-499eed42608a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:32:59.723510 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c41a1314-9d95-41a3-a6e4-499eed42608a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:32:59.751321 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c41a1314-9d95-41a3-a6e4-499eed42608a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041210 May 23 20:32:59.751855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 600/1175] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:32:59 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:00.720821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:00.721549 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:00.727762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:00.728214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:00.728942 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:00.729371 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:00.761851 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-3e61dcfb-25f3-45aa-a612-77f592267348 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:00.762798 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-3e61dcfb-25f3-45aa-a612-77f592267348 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:00.769742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e61dcfb-25f3-45aa-a612-77f592267348 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:00.770229 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e61dcfb-25f3-45aa-a612-77f592267348 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:00.770992 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e61dcfb-25f3-45aa-a612-77f592267348 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:00.771424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-3e61dcfb-25f3-45aa-a612-77f592267348 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:00.800812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-3e61dcfb-25f3-45aa-a612-77f592267348 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042790 May 23 20:33:00.801567 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 601/1176] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:33:00 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:33:00.860063 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:00.867538 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9aaf0de8-8536-4e61-b46f-43d355578790 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.150996 May 23 20:33:00.868096 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 576/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:00 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:01.819522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-216ad361-0baa-40ab-839e-6c3e9077f664 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:01.820470 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-216ad361-0baa-40ab-839e-6c3e9077f664 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:01.829695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-216ad361-0baa-40ab-839e-6c3e9077f664 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:01.830179 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-216ad361-0baa-40ab-839e-6c3e9077f664 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:01.830995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-216ad361-0baa-40ab-839e-6c3e9077f664 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:01.831456 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-216ad361-0baa-40ab-839e-6c3e9077f664 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:01.861091 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-216ad361-0baa-40ab-839e-6c3e9077f664 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052258 May 23 20:33:01.864690 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 602/1178] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:33:01 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:01.884799 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:01.886151 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:01.893135 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:01.893664 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:01.894593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:01.895282 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:02.209762 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:02.228890 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-6e7e752d-36c8-4b29-bfed-cc8bc2a655e7 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1575 microversion: 2.1 time: 0.348046 May 23 20:33:02.229469 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 577/1179] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:01 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1575 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:02.430339 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-a0b82fbf-aca5-4a9a-9139-b979554a5b58 req-a8d2246e-1f13-49ff-a7bf-826d9be1e8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd", "name": "network-vif-deleted", "tag": "3da1951e-32c2-4a10-87c3-ed8bd6400eff"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:02.440070 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-a0b82fbf-aca5-4a9a-9139-b979554a5b58 req-a8d2246e-1f13-49ff-a7bf-826d9be1e8d7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:02.440706 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-a0b82fbf-aca5-4a9a-9139-b979554a5b58 req-a8d2246e-1f13-49ff-a7bf-826d9be1e8d7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:02.452684 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-a0b82fbf-aca5-4a9a-9139-b979554a5b58 req-a8d2246e-1f13-49ff-a7bf-826d9be1e8d7 service nova] Creating event network-vif-deleted:3da1951e-32c2-4a10-87c3-ed8bd6400eff for instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd on hv-cinder-84301 May 23 20:33:02.457694 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-a0b82fbf-aca5-4a9a-9139-b979554a5b58 req-a8d2246e-1f13-49ff-a7bf-826d9be1e8d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031435 May 23 20:33:02.458407 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 603/1180] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:02.873233 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-2ddb653a-25d1-4028-a17b-9f133910856d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:02.875190 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-2ddb653a-25d1-4028-a17b-9f133910856d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:02.882933 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2ddb653a-25d1-4028-a17b-9f133910856d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:02.889612 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2ddb653a-25d1-4028-a17b-9f133910856d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:02.891024 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2ddb653a-25d1-4028-a17b-9f133910856d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:02.891481 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-2ddb653a-25d1-4028-a17b-9f133910856d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:02.925278 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-2ddb653a-25d1-4028-a17b-9f133910856d tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054424 May 23 20:33:02.928111 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 578/1181] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:33:02 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:03.247034 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:03.247730 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:03.253906 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:03.254413 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:03.255166 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:03.255599 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:03.287171 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:03.287650 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:03.288089 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lazy-loading 'fault' on Instance uuid f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:33:03.385511 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:03.395418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-65695934-ab18-40e3-bae5-e12af753a5ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 200 len: 1395 microversion: 2.1 time: 0.152962 May 23 20:33:03.401507 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 604/1182] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:03 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 1395 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:03.935825 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-96891c94-105a-4ffd-b5ae-2ff8405e0012 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:03.936755 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-96891c94-105a-4ffd-b5ae-2ff8405e0012 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:03.943504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96891c94-105a-4ffd-b5ae-2ff8405e0012 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:03.944221 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96891c94-105a-4ffd-b5ae-2ff8405e0012 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:03.944989 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96891c94-105a-4ffd-b5ae-2ff8405e0012 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:03.945424 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-96891c94-105a-4ffd-b5ae-2ff8405e0012 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:03.972652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-96891c94-105a-4ffd-b5ae-2ff8405e0012 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041456 May 23 20:33:03.973192 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 579/1183] 10.222.0.16 () {58 vars in 1301 bytes} [Mon May 23 20:33:03 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 23 20:33:03.983305 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:03.983795 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:03.989781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:03.990262 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:03.991013 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:03.991483 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:04.065699 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] HTTP exception thrown: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 is not attached to volume 813a19a1-edbc-4594-b7b0-51d41202057a May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Request method failure captured: May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments/813a19a1-edbc-4594-b7b0-51d41202057a HTTP/1.1 May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-6v3Bbgoq8rjidkZm4_AeQbNzRqq0eakkapZdOj2sqEF6wFyhlZ-qxMwu5SV-TwL4H4H8gsMyeHfVVdD_-pe7gkwtOW1KTrbVcQ4v7XFXRm7h3bebu5jYXW2qZPk_UvyDo3uhqiIooIlrG_qYljcRcZcPlhoJ60iY0jclsSCsoSfaM May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: add3d6328c754244a17f23d21ff30fac May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-TestMinimumBasicScenario-1637718339 May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:33:04.078071 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_add3d6328c754244a17f23d21ff30fac", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add3d6328c754244a17f23d21ff30fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/add3d6328c754244a17f23d21ff30fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add3d6328c754244a17f23d21ff30fac"}]}] May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-TestMinimumBasicScenario-1637718339 May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: add3d6328c754244a17f23d21ff30fac May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1637718339 May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-TestMinimumBasicScenario-1637718339-project May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: e6dc0d72c1fb4c2fb4f0b704ffafadb1 May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-TestMinimumBasicScenario-1637718339-project May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:33:04.079823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 is not attached to volume 813a19a1-edbc-4594-b7b0-51d41202057a May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'server_id': 'dd0514fc-e707-470d-aedc-d33f24833ff4', 'id': '813a19a1-edbc-4594-b7b0-51d41202057a'} May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 813a19a1-edbc-4594-b7b0-51d41202057a. May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:33:04.080710 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 is not attached to volume 813a19a1-edbc-4594-b7b0-51d41202057a May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 is not attached to volume 813a19a1-edbc-4594-b7b0-51d41202057a May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:04.090534 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Returning 404 to user: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 is not attached to volume 813a19a1-edbc-4594-b7b0-51d41202057a {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:33:04.092469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e8159368-91ad-418d-bad5-11c96fe0a6a5 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments/813a19a1-edbc-4594-b7b0-51d41202057a" status: 404 len: 154 microversion: 2.1 time: 0.101380 May 23 20:33:04.092469 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 605/1184] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:33:03 2022] DELETE /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4/os-volume_attachments/813a19a1-edbc-4594-b7b0-51d41202057a => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:33:04.417083 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:04.417702 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:04.424249 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:04.424864 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:04.425465 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:04.425901 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:04.439617 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] HTTP exception thrown: Instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd could not be found. May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Request method failure captured: May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd HTTP/1.1 May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-2PstBqqCEBz2pTMw1lH6sDEhs_aa2I4a5nNtSSoI7QkPCpq7RzwPD94KXn17y3V2nzJoUD_GHuYZzMIHdi0WuxhEa1_JaYhlcpgu6AdI9E2BHPZKXPfdlVJ0OKsHkUjTFjobUb7fCf-C5HNqf5ESlEU3zACEQXPsSNHclYvFkM7b4 May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:33:04.441265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26567fb564314003bf5ae836737b990e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26567fb564314003bf5ae836737b990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}] May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-TestVolumeBootPattern-529201914 May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 7231b60e5f9541629fec2291c547f0f4 May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd could not be found. May 23 20:33:04.442916 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': 'f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd'} May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd could not be found. May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:33:04.444219 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd could not be found. May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd could not be found. May 23 20:33:04.445876 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:04.447886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Returning 404 to user: Instance f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:33:04.447886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-09480e2f-854c-4aa2-b506-16aba7d3cd76 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd" status: 404 len: 111 microversion: 2.1 time: 0.029662 May 23 20:33:04.447886 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 580/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:04 2022] GET /compute/v2.1/servers/f6c4d7f6-9b0d-43b0-a0e1-22c441d1cfbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:33:06.717500 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:33:06.718087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:33:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:33:07.465618 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:07.466612 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:07.473645 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:07.474116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:07.474867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:07.475294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:07.499353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:33:07.820693 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-aea9dd23-8d42-453c-827e-040638de5583 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 204 len: 0 microversion: 2.1 time: 0.358511 May 23 20:33:07.821643 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 606/1186] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:33:07 2022] DELETE /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:33:07.830158 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:07.830791 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:07.837666 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:07.838157 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:07.838937 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:07.839368 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:07.982652 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:07.992041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-11173d81-692d-4c6f-8f3d-0d8d92ce24bd tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.166193 May 23 20:33:07.992722 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 581/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:07 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:09.010514 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:09.011216 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:09.017721 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:09.018203 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:09.018959 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:09.019394 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:09.149353 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:09.156941 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d5d5f1ce-b3cc-4605-8be8-f2bd936ec75a tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.150628 May 23 20:33:09.157437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 607/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:09 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:10.027489 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:10.028313 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:10.029943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-1df8596c-e93d-4589-9949-e2bc17427617 req-01f75aa8-7a22-4dfc-bf80-5199614da82a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd76191-07fb-44e2-af58-b6a847a04996", "tag": "ded069bc-1e0c-448e-8af6-6ea2d76dc8f8"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:10.035919 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:10.036374 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:10.037507 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:10.037948 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:10.039774 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-1df8596c-e93d-4589-9949-e2bc17427617 req-01f75aa8-7a22-4dfc-bf80-5199614da82a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:10.040354 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-1df8596c-e93d-4589-9949-e2bc17427617 req-01f75aa8-7a22-4dfc-bf80-5199614da82a service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:10.051742 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-1df8596c-e93d-4589-9949-e2bc17427617 req-01f75aa8-7a22-4dfc-bf80-5199614da82a service nova] Creating event network-changed:ded069bc-1e0c-448e-8af6-6ea2d76dc8f8 for instance fdd76191-07fb-44e2-af58-b6a847a04996 on hv-cinder-84301 May 23 20:33:10.056581 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-1df8596c-e93d-4589-9949-e2bc17427617 req-01f75aa8-7a22-4dfc-bf80-5199614da82a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030610 May 23 20:33:10.057723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 608/1189] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:33:10.065960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:33:10.173728 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:10.174425 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:10.180668 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:10.181114 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:10.181876 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:10.182343 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:10.302883 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-292820c1-ac0b-48cc-9948-c112380d2422 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 204 len: 0 microversion: 2.1 time: 0.279416 May 23 20:33:10.303726 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 582/1190] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:33:10 2022] DELETE /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:33:10.312914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:10.313720 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:10.320121 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:10.320323 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:10.320641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:10.321421 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:10.321854 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:10.328898 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-949db645-5ac2-4d59-9647-58c1b005a296 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.158950 May 23 20:33:10.338463 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 609/1191] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:10 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:33:10.458209 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:10.466508 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ce5cbaf1-45e7-411c-a308-f9558e2d4bd3 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1576 microversion: 2.1 time: 0.158284 May 23 20:33:10.467108 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 583/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:10 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:11.347014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:11.347628 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:11.354036 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:11.354499 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:11.355283 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:11.355715 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:11.483317 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:11.484996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:11.485631 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:11.490895 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-649eebe1-aaea-4fb1-b229-19bd55b1c874 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.148639 May 23 20:33:11.491451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 610/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:11 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:11.491684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:11.492159 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:11.492970 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:11.493405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:11.626912 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:11.634375 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ef2cc04e-cd49-45dd-9ee7-9d6e884d2829 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1576 microversion: 2.1 time: 0.154082 May 23 20:33:11.634938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 584/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:11 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:33:12.508723 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:12.510053 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:12.519294 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:12.519815 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:12.520652 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:12.521159 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:12.651887 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:12.652594 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:12.654948 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:12.656503 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:12.660265 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:12.660707 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:12.661525 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:12.661918 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:12.664072 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-324fbc88-05b0-41a3-aadf-8df106ba6491 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.160172 May 23 20:33:12.669812 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 611/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:12 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:12.791436 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:12.798904 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-f9c3cf8d-f178-4b35-a3d9-1ebd550880fd tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1576 microversion: 2.1 time: 0.150901 May 23 20:33:12.799465 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 585/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:12 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:33:13.681743 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:13.682385 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:13.689424 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:13.689868 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:13.690681 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:13.691112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:13.814890 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:13.816302 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:13.816918 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:13.822654 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d136ddab-4777-4a63-a384-59d2ce55cc7b tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.144776 May 23 20:33:13.823204 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 612/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:13 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:13.823340 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:13.823738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:13.824577 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:13.825016 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:13.954475 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:13.961899 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-7327e0a5-0d4f-4691-9088-1b277c174691 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1576 microversion: 2.1 time: 0.149943 May 23 20:33:13.962483 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 586/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:13 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:33:14.839747 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:14.840352 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:14.846855 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:14.847301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:14.848054 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:14.848497 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:14.975860 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:14.979684 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:14.980346 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:14.983540 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-c08b4318-5366-4919-a6be-c7d64ae0cb55 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.147636 May 23 20:33:14.984622 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 613/1199] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:14 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:14.987172 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:14.987620 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:14.988387 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:14.988824 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:15.116960 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:15.124508 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-29af6a16-e067-4b6c-9dd3-2c86c5d409ba tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1576 microversion: 2.1 time: 0.148985 May 23 20:33:15.125695 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 587/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:14 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:33:15.289821 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:33:15.290080 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Mon May 23 20:33:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:33:15.334269 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-22b5648b-32da-4fdd-b6b1-1c75ad54210a req-b114fff9-6e3d-40ac-a12d-703f255580d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "name": "network-vif-unplugged", "status": "completed", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:15.342394 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-22b5648b-32da-4fdd-b6b1-1c75ad54210a req-b114fff9-6e3d-40ac-a12d-703f255580d5 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:15.342879 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-22b5648b-32da-4fdd-b6b1-1c75ad54210a req-b114fff9-6e3d-40ac-a12d-703f255580d5 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:15.355520 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-22b5648b-32da-4fdd-b6b1-1c75ad54210a req-b114fff9-6e3d-40ac-a12d-703f255580d5 service nova] Creating event network-vif-unplugged:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:33:15.361780 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-22b5648b-32da-4fdd-b6b1-1c75ad54210a req-b114fff9-6e3d-40ac-a12d-703f255580d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030737 May 23 20:33:15.362203 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 614/1201] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:33:16.001146 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:16.002612 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:16.009718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:16.010949 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:16.011751 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:16.012338 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:16.143832 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:16.144527 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:16.151758 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:16.152636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:16.153464 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:16.153995 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:16.200765 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:16.214504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-712bd698-fdb3-4a01-9c43-b06d8e315aaa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1554 microversion: 2.1 time: 0.214752 May 23 20:33:16.214504 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 588/1202] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:15 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:16.371991 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-1fe39ee4-f250-48cc-8661-519a008e872c req-6f5311d7-06bb-48a7-a6c9-9227fd65728e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0514fc-e707-470d-aedc-d33f24833ff4", "name": "network-vif-deleted", "tag": "67a1ec00-9ca3-4f89-91f2-5e327a06d58b"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:16.376564 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:16.380336 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:16.381391 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-1fe39ee4-f250-48cc-8661-519a008e872c req-6f5311d7-06bb-48a7-a6c9-9227fd65728e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:16.381843 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-1fe39ee4-f250-48cc-8661-519a008e872c req-6f5311d7-06bb-48a7-a6c9-9227fd65728e service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:16.385713 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:16.385901 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-070b0341-f818-4f74-ba96-0e590d3ab15a tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1457 microversion: 2.1 time: 0.247241 May 23 20:33:16.394107 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-1fe39ee4-f250-48cc-8661-519a008e872c req-6f5311d7-06bb-48a7-a6c9-9227fd65728e service nova] Creating event network-vif-deleted:67a1ec00-9ca3-4f89-91f2-5e327a06d58b for instance dd0514fc-e707-470d-aedc-d33f24833ff4 on hv-cinder-84301 May 23 20:33:16.395996 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 615/1203] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:16 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1457 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 23 20:33:16.399222 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-1fe39ee4-f250-48cc-8661-519a008e872c req-6f5311d7-06bb-48a7-a6c9-9227fd65728e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030972 May 23 20:33:16.399805 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 589/1204] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 23 20:33:16.606954 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-be3dc040-cebb-4f17-9969-90bc81219063 req-46f44ccb-f531-4192-aa02-c75da9c10b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd76191-07fb-44e2-af58-b6a847a04996", "name": "network-vif-deleted", "tag": "ded069bc-1e0c-448e-8af6-6ea2d76dc8f8"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:16.615866 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-be3dc040-cebb-4f17-9969-90bc81219063 req-46f44ccb-f531-4192-aa02-c75da9c10b42 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:16.616301 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-be3dc040-cebb-4f17-9969-90bc81219063 req-46f44ccb-f531-4192-aa02-c75da9c10b42 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:16.627686 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-be3dc040-cebb-4f17-9969-90bc81219063 req-46f44ccb-f531-4192-aa02-c75da9c10b42 service nova] Creating event network-vif-deleted:ded069bc-1e0c-448e-8af6-6ea2d76dc8f8 for instance fdd76191-07fb-44e2-af58-b6a847a04996 on hv-cinder-84301 May 23 20:33:16.632375 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-be3dc040-cebb-4f17-9969-90bc81219063 req-46f44ccb-f531-4192-aa02-c75da9c10b42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029396 May 23 20:33:16.632943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 616/1205] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:17.229535 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:17.230269 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:17.237372 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:17.237853 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:17.238655 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:17.239102 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:17.270413 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:17.270413 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:17.270759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lazy-loading 'fault' on Instance uuid dd0514fc-e707-470d-aedc-d33f24833ff4 {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:33:17.311625 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dc0d72c1fb4c2fb4f0b704ffafadb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add3d6328c754244a17f23d21ff30fac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:17.319413 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-48b2ff82-597e-4c3b-8121-2fa932724cf7 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 200 len: 1348 microversion: 2.1 time: 0.094642 May 23 20:33:17.319996 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 590/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:17 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:17.403803 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:17.404494 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:17.407003 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:17.412116 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:17.412559 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:17.413335 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:17.413763 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:17.443230 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:17.443925 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:17.444361 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lazy-loading 'fault' on Instance uuid fdd76191-07fb-44e2-af58-b6a847a04996 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:33:17.488447 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7231b60e5f9541629fec2291c547f0f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26567fb564314003bf5ae836737b990e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:17.495905 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d7459752-5040-4f10-91ad-6af4e05b94b0 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 200 len: 1231 microversion: 2.1 time: 0.097068 May 23 20:33:17.496455 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 617/1207] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:17 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:18.337209 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:18.337819 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] [instance: dd0514fc-e707-470d-aedc-d33f24833ff4] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:18.344444 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:18.344892 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:18.345650 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:18.346113 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:18.362125 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] HTTP exception thrown: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 could not be found. May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Request method failure captured: May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 HTTP/1.1 May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-6v3Bbgoq8rjidkZm4_AeQbNzRqq0eakkapZdOj2sqEF6wFyhlZ-qxMwu5SV-TwL4H4H8gsMyeHfVVdD_-pe7gkwtOW1KTrbVcQ4v7XFXRm7h3bebu5jYXW2qZPk_UvyDo3uhqiIooIlrG_qYljcRcZcPlhoJ60iY0jclsSCsoSfaM May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: add3d6328c754244a17f23d21ff30fac May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-TestMinimumBasicScenario-1637718339 May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:33:18.363738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_add3d6328c754244a17f23d21ff30fac", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add3d6328c754244a17f23d21ff30fac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/add3d6328c754244a17f23d21ff30fac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/add3d6328c754244a17f23d21ff30fac"}]}] May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-TestMinimumBasicScenario-1637718339 May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: add3d6328c754244a17f23d21ff30fac May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1637718339 May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-TestMinimumBasicScenario-1637718339-project May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: e6dc0d72c1fb4c2fb4f0b704ffafadb1 May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-TestMinimumBasicScenario-1637718339-project May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 could not be found. May 23 20:33:18.365405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': 'dd0514fc-e707-470d-aedc-d33f24833ff4'} May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 could not be found. May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:33:18.366555 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 could not be found. May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 could not be found. May 23 20:33:18.368143 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.369642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Returning 404 to user: Instance dd0514fc-e707-470d-aedc-d33f24833ff4 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:33:18.369642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-88e9cfb8-924b-462c-a361-3818f34b5190 tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4" status: 404 len: 111 microversion: 2.1 time: 0.032112 May 23 20:33:18.369642 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 591/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:18 2022] GET /compute/v2.1/servers/dd0514fc-e707-470d-aedc-d33f24833ff4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:33:18.373888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9e37135d-0e15-43f6-92a7-f4f5daa6fafa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] Calling method '.version_select at 0x7f996cef63a0>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:18.474147 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9e37135d-0e15-43f6-92a7-f4f5daa6fafa tempest-TestMinimumBasicScenario-1637718339 tempest-TestMinimumBasicScenario-1637718339-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-124171138" status: 202 len: 0 microversion: 2.1 time: 0.104273 May 23 20:33:18.474914 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 618/1209] 10.222.0.16 () {58 vars in 1268 bytes} [Mon May 23 20:33:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-124171138 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:33:18.512438 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:18.513052 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: fdd76191-07fb-44e2-af58-b6a847a04996] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:18.519763 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:18.520212 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:18.520983 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:18.521421 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:18.535567 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] HTTP exception thrown: Instance fdd76191-07fb-44e2-af58-b6a847a04996 could not be found. May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Request method failure captured: May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 HTTP/1.1 May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-2PstBqqCEBz2pTMw1lH6sDEhs_aa2I4a5nNtSSoI7QkPCpq7RzwPD94KXn17y3V2nzJoUD_GHuYZzMIHdi0WuxhEa1_JaYhlcpgu6AdI9E2BHPZKXPfdlVJ0OKsHkUjTFjobUb7fCf-C5HNqf5ESlEU3zACEQXPsSNHclYvFkM7b4 May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:33:18.537069 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26567fb564314003bf5ae836737b990e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26567fb564314003bf5ae836737b990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}] May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-TestVolumeBootPattern-529201914 May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 7231b60e5f9541629fec2291c547f0f4 May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance fdd76191-07fb-44e2-af58-b6a847a04996 could not be found. May 23 20:33:18.538797 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': 'fdd76191-07fb-44e2-af58-b6a847a04996'} May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd76191-07fb-44e2-af58-b6a847a04996 could not be found. May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:33:18.539627 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd76191-07fb-44e2-af58-b6a847a04996 could not be found. May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd76191-07fb-44e2-af58-b6a847a04996 could not be found. May 23 20:33:18.540895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:18.542059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Returning 404 to user: Instance fdd76191-07fb-44e2-af58-b6a847a04996 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:33:18.542059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-1418595f-ecab-419b-b19f-46a1438f15f6 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996" status: 404 len: 111 microversion: 2.1 time: 0.029905 May 23 20:33:18.542059 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 592/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:18 2022] GET /compute/v2.1/servers/fdd76191-07fb-44e2-af58-b6a847a04996 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:33:18.991858 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:33:18.992021 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:33:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:33:19.050519 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:19.051014 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:19.057703 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:19.063792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:19.063792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:19.063792 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:19.074311 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] HTTP exception thrown: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Request method failure captured: May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: DELETE /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 HTTP/1.1 May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-2PstBqqCEBz2pTMw1lH6sDEhs_aa2I4a5nNtSSoI7QkPCpq7RzwPD94KXn17y3V2nzJoUD_GHuYZzMIHdi0WuxhEa1_JaYhlcpgu6AdI9E2BHPZKXPfdlVJ0OKsHkUjTFjobUb7fCf-C5HNqf5ESlEU3zACEQXPsSNHclYvFkM7b4 May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:33:19.075944 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26567fb564314003bf5ae836737b990e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26567fb564314003bf5ae836737b990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}] May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-TestVolumeBootPattern-529201914 May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 7231b60e5f9541629fec2291c547f0f4 May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.077600 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '2ee0bc7f-636f-4b77-bbf0-90e168f07e57'} May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:33:19.079126 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.080729 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:33:19.086865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Returning 404 to user: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:33:19.086865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-2cf6f8a8-3e5d-4b75-babc-e2176d4285da tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 404 len: 111 microversion: 2.1 time: 0.030917 May 23 20:33:19.086865 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 619/1211] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:33:19 2022] DELETE /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:33:19.089207 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:19.089924 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] [instance: 2ee0bc7f-636f-4b77-bbf0-90e168f07e57] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:19.096145 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:19.096533 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:19.097405 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:19.097738 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:19.112300 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] HTTP exception thrown: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Request method failure captured: May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 HTTP/1.1 May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-2PstBqqCEBz2pTMw1lH6sDEhs_aa2I4a5nNtSSoI7QkPCpq7RzwPD94KXn17y3V2nzJoUD_GHuYZzMIHdi0WuxhEa1_JaYhlcpgu6AdI9E2BHPZKXPfdlVJ0OKsHkUjTFjobUb7fCf-C5HNqf5ESlEU3zACEQXPsSNHclYvFkM7b4 May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:33:19.113938 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26567fb564314003bf5ae836737b990e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26567fb564314003bf5ae836737b990e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26567fb564314003bf5ae836737b990e"}]}] May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-TestVolumeBootPattern-529201914 May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: 26567fb564314003bf5ae836737b990e May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-TestVolumeBootPattern-529201914 May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 7231b60e5f9541629fec2291c547f0f4 May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-TestVolumeBootPattern-529201914-project May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.115699 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '2ee0bc7f-636f-4b77-bbf0-90e168f07e57'} May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:33:19.116795 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. May 23 20:33:19.118361 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:19.119829 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Returning 404 to user: Instance 2ee0bc7f-636f-4b77-bbf0-90e168f07e57 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:33:19.119829 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-a408a070-bef6-4792-9354-ab0226b60044 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57" status: 404 len: 111 microversion: 2.1 time: 0.032019 May 23 20:33:19.119829 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 593/1212] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:19 2022] GET /compute/v2.1/servers/2ee0bc7f-636f-4b77-bbf0-90e168f07e57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:33:19.957187 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:19.957187 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:19.963514 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:19.963956 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:19.964709 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:19.965136 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:20.053290 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lazy-loading 'services' on Instance uuid 30a1911a-62de-46bb-aff3-872e9f2f0a86 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:33:20.238194 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-d83a9018-7ee6-48d3-a295-b005ed74425e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86/os-volume_attachments/567b51c3-9dda-43c2-94c6-a79693330b73" status: 202 len: 0 microversion: 2.1 time: 0.286054 May 23 20:33:20.238814 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 620/1213] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:33:19 2022] DELETE /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86/os-volume_attachments/567b51c3-9dda-43c2-94c6-a79693330b73 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:33:20.620767 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-77b8de0d-1305-476f-ac99-e446a22cdc96 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] Calling method '.version_select at 0x7f996d638310>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:20.708941 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-77b8de0d-1305-476f-ac99-e446a22cdc96 tempest-TestVolumeBootPattern-529201914 tempest-TestVolumeBootPattern-529201914-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2119033645" status: 202 len: 0 microversion: 2.1 time: 0.091983 May 23 20:33:20.709546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 594/1214] 10.222.0.16 () {58 vars in 1262 bytes} [Mon May 23 20:33:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2119033645 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:33:21.362309 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:21.364140 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:21.385100 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:21.385531 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:21.386528 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:21.386963 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:21.415450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Going to try to terminate instance {{(pid=118170) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:33:21.719184 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-cd168d08-0137-4533-a47c-c7afd9f60b09 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "DELETE /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 204 len: 0 microversion: 2.1 time: 0.363800 May 23 20:33:21.720366 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 621/1215] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:33:21 2022] DELETE /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:33:21.731027 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:21.731546 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:21.739398 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:21.744759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:21.744759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:21.744759 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:21.879395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:21.887718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-9d06cab8-7eb8-419c-92c6-fdc96975a16f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1514 microversion: 2.1 time: 0.162697 May 23 20:33:21.888838 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 595/1216] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:21 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:22.905492 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:22.907016 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:22.914986 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:22.918182 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:22.918182 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:22.918182 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:23.429694 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:23.439214 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-37966174-d551-428a-9329-3cce1408c883 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1514 microversion: 2.1 time: 0.538033 May 23 20:33:23.440716 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 622/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:22 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1514 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:24.123041 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-ada5dc91-f8f2-4c5a-9830-8af33fc43f49 req-5837c81d-87ec-4b49-b8a2-d553e5dd95cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30a1911a-62de-46bb-aff3-872e9f2f0a86", "name": "network-vif-deleted", "tag": "8cab2ea6-541e-419e-a704-f4bb40220d62"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:24.133114 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-ada5dc91-f8f2-4c5a-9830-8af33fc43f49 req-5837c81d-87ec-4b49-b8a2-d553e5dd95cd service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:24.134157 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-ada5dc91-f8f2-4c5a-9830-8af33fc43f49 req-5837c81d-87ec-4b49-b8a2-d553e5dd95cd service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:24.146148 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-ada5dc91-f8f2-4c5a-9830-8af33fc43f49 req-5837c81d-87ec-4b49-b8a2-d553e5dd95cd service nova] Creating event network-vif-deleted:8cab2ea6-541e-419e-a704-f4bb40220d62 for instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 on hv-cinder-84301 May 23 20:33:24.152557 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-ada5dc91-f8f2-4c5a-9830-8af33fc43f49 req-5837c81d-87ec-4b49-b8a2-d553e5dd95cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033967 May 23 20:33:24.153312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 596/1218] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:24.456903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:24.461716 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:24.473418 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:24.474217 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:24.475186 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:24.475790 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:24.516847 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:24.516847 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:24.516847 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lazy-loading 'fault' on Instance uuid 30a1911a-62de-46bb-aff3-872e9f2f0a86 {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:33:24.562339 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:24.566680 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-efa12f4f-962e-43de-b364-2e43a95cb56a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 200 len: 1309 microversion: 2.1 time: 0.113806 May 23 20:33:24.567239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 623/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:24 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:25.585007 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:25.586395 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 30a1911a-62de-46bb-aff3-872e9f2f0a86] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:25.593379 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:25.594179 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:25.595054 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:25.595575 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:25.610180 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.wsgi [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] HTTP exception thrown: Instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 could not be found. May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Request method failure captured: May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: request: GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 HTTP/1.1 May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept: application/json May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Accept-Encoding: identity May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Connection: close May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Length: 0 May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Content-Type: application/json May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Host: 10.222.0.16 May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Openstack-System-Scope: None May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: User-Agent: python-urllib3/1.26.9 May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Auth-Token: gAAAAABii-8ZIxvrsaG00Ey3TBI2Fr_sQD93TzR0fRuVGFXPT7FqDXaOeGz6WSO7T140ceyg-8jPaXrexX1lwRqKewTpjBJW7-6do_FA3eRn3ZxDdo0VRoXXy9I2EBxYqc5Z5JpNmydawm6OFy6bNbV9ucfx-hjdCqQgCnARcowZoFPZTAT_p30 May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Id: None May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Domain-Name: None May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Identity-Status: Confirmed May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Is-Admin-Project: True May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Id: default May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Domain-Name: Default May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Id: fba86b652dc24d4784eb3caa4d3ed300 May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1282987402 May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Role: reader,member May 23 20:33:25.611946 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Roles: reader,member May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fba86b652dc24d4784eb3caa4d3ed300", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fba86b652dc24d4784eb3caa4d3ed300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fba86b652dc24d4784eb3caa4d3ed300"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fba86b652dc24d4784eb3caa4d3ed300"}]}] May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant: tempest-VolumesSnapshotTestJSON-1282987402 May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Id: fba86b652dc24d4784eb3caa4d3ed300 May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1282987402 May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User: tempest-VolumesSnapshotTestJSON-1282987402-project May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Id: default May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Domain-Name: Default May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Id: 47e7f40810184611bfdd184a35dc26fc May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: X-User-Name: tempest-VolumesSnapshotTestJSON-1282987402-project May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: method: > May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: exception: Instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 could not be found. May 23 20:33:25.614194 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: action_args: {'id': '30a1911a-62de-46bb-aff3-872e9f2f0a86'} May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 could not be found. May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:33:25.615040 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 could not be found. May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 could not be found. May 23 20:33:25.616335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: ERROR nova.api.openstack.wsgi May 23 20:33:25.618664 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Returning 404 to user: Instance 30a1911a-62de-46bb-aff3-872e9f2f0a86 could not be found. {{(pid=118171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:33:25.618664 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-11c97638-bc8f-4477-a061-5a2122a7a42d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86" status: 404 len: 111 microversion: 2.1 time: 0.032947 May 23 20:33:25.618664 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 597/1220] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:25 2022] GET /compute/v2.1/servers/30a1911a-62de-46bb-aff3-872e9f2f0a86 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:33:34.084143 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1902180779", "imageRef": "f7b6f50a-cce4-4533-bc86-6486f6b2576a", "flavorRef": "452", "networks": [{"uuid": "e8bec14f-5f2f-4971-9ffa-fd587de3b5b8"}]}} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:34.135850 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.network.neutron [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] validate_networks() for [('e8bec14f-5f2f-4971-9ffa-fd587de3b5b8', None, None, None, None, None)] {{(pid=118170) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 23 20:33:34.480175 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Flavor limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 23 20:33:34.480598 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Image limits 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 23 20:33:34.481068 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Flavor pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 23 20:33:34.481504 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Image pref 0:0:0 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 23 20:33:34.481913 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.virt.hardware [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118170) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 23 20:33:34.490769 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:34.491209 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:34.492001 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:34.492433 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:34.509767 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Getting quotas for project fba86b652dc24d4784eb3caa4d3ed300. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 23 20:33:34.513719 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.quota [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Getting quotas for user 47e7f40810184611bfdd184a35dc26fc and project fba86b652dc24d4784eb3caa4d3ed300. Resources: {'ram', 'cores', 'instances'} {{(pid=118170) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 23 20:33:34.524874 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Going to run 1 instances... {{(pid=118170) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 23 20:33:34.527135 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f7b6f50a-cce4-4533-bc86-6486f6b2576a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118170) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 23 20:33:34.667622 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-0b41db95-5824-4557-836e-0cbf651c2bd4 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587387 May 23 20:33:34.668256 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 624/1221] 10.222.0.16 () {60 vars in 1146 bytes} [Mon May 23 20:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 23 20:33:34.678185 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-23006dbd-3b32-47ca-9756-c7233d84467f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:34.678882 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-23006dbd-3b32-47ca-9756-c7233d84467f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:34.734736 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-23006dbd-3b32-47ca-9756-c7233d84467f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:34.741317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-23006dbd-3b32-47ca-9756-c7233d84467f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1219 microversion: 2.1 time: 0.067007 May 23 20:33:34.741895 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 598/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:34 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:35.758450 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:35.759062 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:35.765154 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:35.765594 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:35.766406 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:35.766910 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:35.834146 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:35.841522 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f864db66-395f-41fc-9b95-1292b78e4760 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1223 microversion: 2.1 time: 0.087524 May 23 20:33:35.842087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 625/1223] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:35 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:36.859327 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:36.859937 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:36.861935 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=24 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:36.868214 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:36.868667 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:36.869433 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:36.869882 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:36.931076 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:36.938913 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-37cc5196-f383-41ca-8b87-4bf39c6f665a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1279 microversion: 2.1 time: 0.084059 May 23 20:33:36.939466 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 599/1224] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:36 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:37.956608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:37.957223 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:37.963823 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:37.964264 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:37.965013 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:37.965437 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:38.117591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:38.125370 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-a72d30f9-15fb-47e0-b50e-b91a31c7829f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.173392 May 23 20:33:38.128395 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 626/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:37 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:38.631545 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [req-34e8c2e0-c51f-470d-8176-2586f3699957 req-9582725e-e559-49ad-802a-19ea948f88d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa", "tag": "1a08e3dc-0aab-4f6d-8851-6019cef4a136"}]} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:38.639785 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-34e8c2e0-c51f-470d-8176-2586f3699957 req-9582725e-e559-49ad-802a-19ea948f88d7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:38.640234 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [req-34e8c2e0-c51f-470d-8176-2586f3699957 req-9582725e-e559-49ad-802a-19ea948f88d7 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:38.651181 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.compute.server_external_events [req-34e8c2e0-c51f-470d-8176-2586f3699957 req-9582725e-e559-49ad-802a-19ea948f88d7 service nova] Creating event network-changed:1a08e3dc-0aab-4f6d-8851-6019cef4a136 for instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa on hv-cinder-84301 May 23 20:33:38.656584 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [req-34e8c2e0-c51f-470d-8176-2586f3699957 req-9582725e-e559-49ad-802a-19ea948f88d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149809 May 23 20:33:38.657184 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 600/1226] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:39.142706 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:39.143295 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:39.149667 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:39.150144 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:39.150888 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:39.151315 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:39.282134 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:39.290276 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-bac20041-ca03-4a3d-bbd0-e8e0e67aae70 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.151620 May 23 20:33:39.290847 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 627/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:39 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:40.308342 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:40.309072 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:40.315335 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:40.315779 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:40.316581 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:40.317015 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:40.443875 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:40.451305 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8d0fea96-fbbd-4335-ab8a-ff1cd72c7820 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.147714 May 23 20:33:40.451851 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 601/1228] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:40 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:41.469128 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:41.469733 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:41.476239 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:41.476627 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:41.477381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:41.477810 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:41.605887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:41.613219 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-1ce5b4dc-25d1-49cf-be51-e38327111f60 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.148575 May 23 20:33:41.613781 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 628/1229] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:41 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:42.629915 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:42.630597 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:42.637105 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:42.637554 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:42.638346 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:42.638788 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:42.768009 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:42.775312 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-e1621d42-5b3c-4b7d-9bc0-93b67b9a6e54 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.149390 May 23 20:33:42.775860 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 602/1230] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:42 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:43.792117 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:43.792757 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:43.799943 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:43.800389 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:43.801149 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:43.801613 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:43.928325 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:43.935627 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-535bf41b-29e6-495c-9e1d-76773aae735a tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.147425 May 23 20:33:43.936183 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 629/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:43 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:44.951573 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:44.952213 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:44.954686 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell0:SELECT=2 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:44.955367 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:44.960029 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:44.964737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:44.964737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:44.964737 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:45.092092 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:45.099591 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-035dc2f8-779c-48f9-a55c-9519bafdd73d tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.151917 May 23 20:33:45.100147 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 603/1232] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:44 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:45.550088 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=2 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:45.550827 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell0:SELECT=6 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:33:45.610055 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-58e42d94-3664-4056-98fc-9b911203b3b0 req-0d2459e7-b262-4e95-8104-132819739774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa", "name": "network-vif-plugged", "status": "completed", "tag": "1a08e3dc-0aab-4f6d-8851-6019cef4a136"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:45.619112 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-58e42d94-3664-4056-98fc-9b911203b3b0 req-0d2459e7-b262-4e95-8104-132819739774 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:45.623676 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-58e42d94-3664-4056-98fc-9b911203b3b0 req-0d2459e7-b262-4e95-8104-132819739774 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:45.630514 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-58e42d94-3664-4056-98fc-9b911203b3b0 req-0d2459e7-b262-4e95-8104-132819739774 service nova] Creating event network-vif-plugged:1a08e3dc-0aab-4f6d-8851-6019cef4a136 for instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa on hv-cinder-84301 May 23 20:33:45.635773 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-58e42d94-3664-4056-98fc-9b911203b3b0 req-0d2459e7-b262-4e95-8104-132819739774 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090828 May 23 20:33:45.636379 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 630/1233] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:33:46.116247 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:46.116850 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:46.123369 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:46.124607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:46.124607 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:46.125519 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:46.251119 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:46.258520 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ac35c215-4595-4b00-b0a6-bf67dc665852 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1319 microversion: 2.1 time: 0.146187 May 23 20:33:46.259064 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 604/1234] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:46 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:47.277443 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:33:47.278193 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:47.285394 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:47.285835 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:47.286636 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:47.287058 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:47.415202 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:33:47.422695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-e59d426f-a3dc-414b-8e3e-93281bdf885b tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1508 microversion: 2.1 time: 0.150692 May 23 20:33:47.423242 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 631/1235] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:33:47 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:33:47.438845 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-8d5d3606-25ae-4b64-8cc5-b3a76ef6cea8 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71ed4fa6-7df2-488e-aa41-0e12c5669d0e", "device": "/dev/sdb"}} {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:33:47.439934 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-8d5d3606-25ae-4b64-8cc5-b3a76ef6cea8 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:33:47.446149 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d5d3606-25ae-4b64-8cc5-b3a76ef6cea8 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:47.446593 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d5d3606-25ae-4b64-8cc5-b3a76ef6cea8 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:47.447339 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d5d3606-25ae-4b64-8cc5-b3a76ef6cea8 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:33:47.447771 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-8d5d3606-25ae-4b64-8cc5-b3a76ef6cea8 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:33:48.154246 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-8d5d3606-25ae-4b64-8cc5-b3a76ef6cea8 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "POST /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719207 May 23 20:33:48.154718 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 605/1236] 10.222.0.16 () {60 vars in 1322 bytes} [Mon May 23 20:33:47 2022] POST /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:34:08.062877 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:34:08.063366 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:34:08.070365 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:34:08.071271 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG dbcounter [-] [118170] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:34:08.080617 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:08.082489 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:08.082489 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:08.082489 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:08.166286 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.objects.instance [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lazy-loading 'services' on Instance uuid 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa {{(pid=118170) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:34:08.386381 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-f6391692-c42b-490c-8946-0344a78388ba tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa/os-volume_attachments/71ed4fa6-7df2-488e-aa41-0e12c5669d0e" status: 202 len: 0 microversion: 2.1 time: 0.327783 May 23 20:34:08.386979 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 632/1237] 10.222.0.16 () {58 vars in 1415 bytes} [Mon May 23 20:34:08 2022] DELETE /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa/os-volume_attachments/71ed4fa6-7df2-488e-aa41-0e12c5669d0e => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 23 20:34:10.546717 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_api:SELECT=5 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:34:10.547512 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG dbcounter [-] [118171] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 23 20:34:10.551550 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:34:10.552136 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:34:10.558215 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:10.569347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:10.569347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:10.569347 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:10.584754 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Going to try to terminate instance {{(pid=118171) delete /opt/stack/nova/nova/compute/api.py:2664}} May 23 20:34:10.861271 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-4718eee6-9c95-466f-ab99-adff494066f3 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 204 len: 0 microversion: 2.1 time: 0.315779 May 23 20:34:10.861796 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 606/1238] 10.222.0.16 () {58 vars in 1238 bytes} [Mon May 23 20:34:10 2022] DELETE /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 23 20:34:10.870491 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:34:10.871189 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:34:10.878515 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:10.879087 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:10.879837 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:10.880292 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:11.011130 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.policy [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118170) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:34:11.018760 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-006344ce-37c7-4256-bb1e-cc1f2923827f tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1514 microversion: 2.1 time: 0.152654 May 23 20:34:11.021588 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 633/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:34:10 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:34:12.037221 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:34:12.037947 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:34:12.044425 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:12.044869 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:12.045619 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:12.046120 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:12.178158 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:34:12.185706 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-ab04f4a4-8230-4f79-bdba-bd5970230900 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1514 microversion: 2.1 time: 0.152760 May 23 20:34:12.186311 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 607/1240] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:34:12 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:34:12.904840 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [req-5f5fede5-568a-4e5f-9f14-bace42dfd00f req-43fa8701-c3a8-4f88-9970-9b338e9982d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa", "name": "network-vif-deleted", "tag": "1a08e3dc-0aab-4f6d-8851-6019cef4a136"}]} {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 23 20:34:12.913489 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-5f5fede5-568a-4e5f-9f14-bace42dfd00f req-43fa8701-c3a8-4f88-9970-9b338e9982d4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:12.917465 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [req-5f5fede5-568a-4e5f-9f14-bace42dfd00f req-43fa8701-c3a8-4f88-9970-9b338e9982d4 service nova] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:12.925318 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.compute.server_external_events [req-5f5fede5-568a-4e5f-9f14-bace42dfd00f req-43fa8701-c3a8-4f88-9970-9b338e9982d4 service nova] Creating event network-vif-deleted:1a08e3dc-0aab-4f6d-8851-6019cef4a136 for instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa on hv-cinder-84301 May 23 20:34:12.930195 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [req-5f5fede5-568a-4e5f-9f14-bace42dfd00f req-43fa8701-c3a8-4f88-9970-9b338e9982d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029070 May 23 20:34:12.930765 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 634/1241] 10.222.0.16 () {64 vars in 1317 bytes} [Mon May 23 20:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 23 20:34:13.203003 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.api.openstack.wsgi [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:34:13.203617 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.compute.api [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118171) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:34:13.210465 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:13.210922 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:13.211702 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:13.212187 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:13.246868 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:13.247326 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG oslo_concurrency.lockutils [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:13.247772 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.objects.instance [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lazy-loading 'fault' on Instance uuid 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa {{(pid=118171) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 23 20:34:13.287679 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: DEBUG nova.policy [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47e7f40810184611bfdd184a35dc26fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fba86b652dc24d4784eb3caa4d3ed300', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118171) authorize /opt/stack/nova/nova/policy.py:199}} May 23 20:34:13.295161 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO nova.api.openstack.requestlog [None req-cacb6fbf-8b1c-4c3b-87d3-01b41bd3622e tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 200 len: 1309 microversion: 2.1 time: 0.096155 May 23 20:34:13.295729 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: [pid: 118171|app: 0|req: 608/1242] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:34:13 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 23 20:34:14.314378 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Calling method '>' {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 23 20:34:14.315012 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.compute.api [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] [instance: 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa] Fetching instance by UUID {{(pid=118170) get /opt/stack/nova/nova/compute/api.py:2920}} May 23 20:34:14.321451 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:14.321895 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:14.322695 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 23 20:34:14.323132 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG oslo_concurrency.lockutils [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Lock "95806c6f-3d47-4566-84e6-920ffa618b20" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 23 20:34:14.336010 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.wsgi [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] HTTP exception thrown: Instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa could not be found. May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Request method failure captured: May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: request: GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa HTTP/1.1 May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept: application/json May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Accept-Encoding: identity May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Connection: close May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Length: 0 May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Content-Type: application/json May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Host: 10.222.0.16 May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Openstack-System-Scope: None May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: User-Agent: python-urllib3/1.26.9 May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Auth-Token: gAAAAABii-8ZIxvrsaG00Ey3TBI2Fr_sQD93TzR0fRuVGFXPT7FqDXaOeGz6WSO7T140ceyg-8jPaXrexX1lwRqKewTpjBJW7-6do_FA3eRn3ZxDdo0VRoXXy9I2EBxYqc5Z5JpNmydawm6OFy6bNbV9ucfx-hjdCqQgCnARcowZoFPZTAT_p30 May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Id: None May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Domain-Name: None May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Identity-Status: Confirmed May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Is-Admin-Project: True May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Id: default May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Domain-Name: Default May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Id: fba86b652dc24d4784eb3caa4d3ed300 May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1282987402 May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Role: reader,member May 23 20:34:14.337591 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Roles: reader,member May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fba86b652dc24d4784eb3caa4d3ed300", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fba86b652dc24d4784eb3caa4d3ed300"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fba86b652dc24d4784eb3caa4d3ed300"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fba86b652dc24d4784eb3caa4d3ed300"}]}] May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant: tempest-VolumesSnapshotTestJSON-1282987402 May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Id: fba86b652dc24d4784eb3caa4d3ed300 May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1282987402 May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User: tempest-VolumesSnapshotTestJSON-1282987402-project May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Id: default May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Domain-Name: Default May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Id: 47e7f40810184611bfdd184a35dc26fc May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: X-User-Name: tempest-VolumesSnapshotTestJSON-1282987402-project May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: method: > May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: exception: Instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa could not be found. May 23 20:34:14.339137 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: action_args: {'id': '6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa'} May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: {{(pid=118170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa could not be found. May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 23 20:34:14.339968 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa could not be found. May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa could not be found. May 23 20:34:14.341573 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: ERROR nova.api.openstack.wsgi May 23 20:34:14.343887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: DEBUG nova.api.openstack.wsgi [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] Returning 404 to user: Instance 6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa could not be found. {{(pid=118170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 23 20:34:14.343887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO nova.api.openstack.requestlog [None req-9e6542bb-9be5-4368-9a30-396bd7ee9714 tempest-VolumesSnapshotTestJSON-1282987402 tempest-VolumesSnapshotTestJSON-1282987402-project] 10.222.0.16 "GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa" status: 404 len: 111 microversion: 2.1 time: 0.030087 May 23 20:34:14.343887 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: [pid: 118170|app: 0|req: 635/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Mon May 23 20:34:14 2022] GET /compute/v2.1/servers/6fe64c8c-7fbd-4e20-89ce-1ed79467c4aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 23 20:36:25.016317 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:36:25.016914 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Mon May 23 20:36:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:36:26.726219 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:36:26.726751 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:36:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:36:35.298641 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:36:35.303062 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Mon May 23 20:36:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:36:39.002025 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:36:39.002608 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:36:42.586867 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:36:42.587461 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:36:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:36:58.144820 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:36:58.145314 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Mon May 23 20:36:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:39:45.025419 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:39:45.026053 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Mon May 23 20:39:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:39:46.734359 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:39:46.734903 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:39:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:39:55.306926 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:39:55.307477 dv-cinder-843018-1-iscsi devstack@n-api.service[118171]: Mon May 23 20:39:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:39:59.009952 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:39:59.010555 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:39:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 23 20:40:02.594926 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 23 20:40:02.595502 dv-cinder-843018-1-iscsi devstack@n-api.service[118170]: Mon May 23 20:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!